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Increased demands on modern technology have established a requirement for gage 
blocks with higher accuracy of length calibration than is currently available. The desired 
improvement is tenfold and involves an increase in reliability from 2X10 -6 in. /in. to 1 or 
2X10 -7 in. /in. The problem of achieving gage blocks dimensionally stable to this degree is 
fundamental and has two aspects; (1) the development of a suitable material and treatment 
to produce a gage block with the desired dimensional stability, surface quality, and several 
other physical properties, (2) the development of instrumentation and techniques for the 
precise measurement of temporal changes of length, so that stability of test samples may be 
determined to the required precision. 

To date the program has been successful in developing three sets of gage blocks from 
two materials that have met the requirements and have shown a dimensional stability of 
2X 10~ 7 in./in./yr over an observed period of one year. A technique for measurement based 
on the use of a mechanical-electronic comparator and a rigorous application of statistical 
control have supplied data precise to within ±2X 10~ 7 in. The processes, technical aspects, 
and techniques involved in these developments are fully explained, and plans for further 
investigation and improvement are indicated. 



1. Introduction 

Gage blocks are precise representatives of the 
national standard of length maintained at the Na- 
tional Bureau of Standards. As such they are in 
general use throughout industry and government for 
direct measurements or as standards for the calibra- 
tion of measuring tools and other devices. Their 
sizes not only should be known and measurable to a 
high degree of precision, but once established, the 
sizes should remain within a desired constancy with 
the passage of time. Many instances are reported 
[l^S] 1 where hardened steel gage blocks have 
changed dimensions upon aging. This dimensional 
instability has been reported as a shrinkage, a 
growth, or even as a change from one to the other at 
different times of measurement. 

Gage blocks purchased for governmental use are 
obtained in accordance with Federal Specification 
GGG-G-15, June 7, 1956. The standards of quality 
specified therein are also in general use throughout 
industry. The best steel gage blocks currently 
available are made to standards designated as AA, 
Laboratory Grade, Class 1, which provide for toler- 
ances on lengths of ±2X10~ 6 in. /in. on blocks longer 
than 1 in. and ±2X10 -6 in. on blocks 1 in. or shorter. 
A minimum hardness of 65 Rockwell C (65 R c ) or 
equivalent on or adjacent to the wringing surface is 
required. The specification also contains allowable 
tolerances on flatness, parallelism, and finish of the 
wringing surfaces, but there are no quantitative 
requirements for dimensional stability; only the 
statement, ". . . suitably treated to assure dimen- 
sional stability of the finished gages." 

Gage blocks are not used to measure to the extreme 



Figures in brackets indicate the literature references at the end of this paper. 



limits of the indicated tolerances; a factor of ten is 
usually allowed to compensate in part for inaccu- 
racies established by dimensional instability, wear, 
and the summation of errors formed in combining 
two or more blocks. With that criterion, current 
commercial blocks are used to measure no closer 
than ±2X 10~ 5 in. /in. With the advent of the space 
and atomic era, the need for measuring to ± 1 or 
2X10 -6 in. /in. is anticipated by industry and recog- 
nized by the Congress of the United States. Such 
a degree of precision would necessitate gage blocks 
with a tolerance of ±1 or 2X10" 7 in. /in. The devel- 
opment of gage blocks to meet this specification 
presents a dual problem of materials and measure- 
ment. Accordingly, the investigation was designed 
to study both facets of this problem and the coopera- 
tive efforts of personnel from two divisions of the 
National Bureau of Standards (Metallurgy, and 
Optics and Metrology) were applied. The Metal- 
lurgy Division was given the responsibility for the 
selection, development, treatment and evaluation 
of materials, and the Optics and Metrology Division 
for the development and improvement of measuring 
techniques and the determination of stability of 
experimental gage blocks. Several companies 2 in- 
terested in the manufacture or application of gage 
blocks, are actively cooperating in the program and 
have supplied invaluable advisory service, the bulk 
of the blank materials used, all of the facilities and 
personnel for lapping, and a portion of the operating 
funds. 



2 Brown & Sharpe Co. 
Dearborn Gage Co. 
Do All Co. 
E. I. du Pont de Nemours & Co., 

Inc. 
Fonda Gage Co. 
General Electric Co. 
Greenfield Tap & Die Corp. 
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International Business Machines 

Corp. 
Link Aviation, Inc. 
New Departure Division of General 

Motors Corp. 
Pratt & Whitney Co., Inc. 
Taft-Peirce Mfg. Co. 
The Sheffield Corp. 
The Timken Roller Bearing Co. 
The Van Keuren Co. 
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W It was apparent from the onset that the program 
was to be a lengthy one which would require years 
to complete. Once suitable techniques for measuring 
blocks to one or two parts in ten million were devel- 
oped, it would still require about eighteen months 
to manufacture a gage block to the required specifi- 
cations, and obtain sufficient stability data to indicate 
a trend. Thus, gage blocks made in 1957 or 1958 
and under observation since 1958 have just begun 
to produce significant data. As a result of these 
observations, additional gage blocks are being de- 
signed for improved performance, but these will not 
show results until the end of 1960. In fact, any 
ideas developed in the program require about eight- 
een months to verify or disprove, and even then such 
a verification can be considered only as tentative 
pending observation over longer periods of time. 

The purpose of this paper is to acquaint the reader 
with the scope of the entire program, to describe 
the materials and procedures being used to produce 
experimental gage blocks and the technical aspects 
involved, to describe the instrumentation and tech- 
niques developed to measure the gage blocks, and 
to present results on two of the selected materials 
which have been observed for stability sufficiently 
long to have produced significant trends. 

2. Previous Investigations 

The dimensional instability of hardened steel for 
gage blocks was described by Rolt [1] in 1929 and 
was recognized by Johansson and others prior to 
that time. In this country many excellent in- 
vestigations have been concerned with the mecha- 
nism of instability of hardened steels and methods of 
alleviating the condition, notably the work of Scott 
[4], Cohen and his associates [5, 6, 7, 8, 9, 10] and 
Gippert and Butler [11]. As a result, hardened 
steel gage blocks undoubtedly can be made more 
stable today than they could many years ago, but 
more stringent requirements make further improve- 
ment necessary. 

A set of gage blocks, said to be of uniform chemical 
composition and processed alike, was purchased in 
1929 by the National Bureau of Standards from C. E. 
Johansson. These blocks were personally selected 
by Johansson for excellence of planeness, paral- 
lelism, surface finish and dimensional stability. 
The stabilizing treatment consisted of several cycles of 
annealing, hardening, tempering and a refrigeration 
treatment at 32° F, although the exact mechanisms 
involved were not fully understood. Several gage 
blocks had also been purchased from the same source 
two years earlier, in 1927, and at that time were 
presumed to have a similar composition and to have 
been given the same heat treatment. These two 
lots of blocks have been observed for length changes 
since their procurement, and the results have been 
varied [2]. Some have a history of constant and 
large growth (up to 2X10 -5 in./in.), others have not- 
varied more than 2X10 ~ 6 in./in., and the rest have 
remained stable or have shrunk slightly for a period 
of one to seven years and then have proceeded to 



grow. Two of the more stable and two of the less 
stable blocks were independently analyzed for 
retained austenite at the Timken Roller Bearing Co. 
[12] and the National Bureau of Standards; the 
results of the two laboratories agreed closely. The 
two more stable blocks contained about 11 percent 
of retained austenite. The least stable of the four 
had 20 percent, and the other unstable block had 15 
percent. These tests not only indicate the large 
variation in stability that may be obtained with 
what must be presumed to be very small variations 
of composition and/or treatment, but also the in- 
adequacy of judging dimensional stability on the 
basis of short-time observations. These blocks also 
supply evidence that the presence of some retained 
austenite need not necessarily promote dimensional 
instability, and ma}^ in fact contribute to stability. 
Observations based on measurements of one year or 
less and which indicate a desirable degree of stability, 
while a favorable sign, cannot be interpreted as final. 
Conversely, an indication of instability during the 
first year may portend further instability during 
future years, although the degree may change and 
exceptions have been noted. 

Other observations of interest have also been 
reported. In individual blocks, rates of change in 
length have varied in different portions of the blocks 
so as to introduce uneveness to previously flat 
surfaces [13]. Several instances have been noted at 
the National Bureau of Standards and elsewhere, 
where the disturbance of a nongaging side surface 
by relapping or even by etching produced an im- 
mediate change in length. Such observations indi- 
cate the presence in hardened steel gage blocks, of a 
delicate balance of residual stresses that produces 
dimensional changes when disturbed. 

The concern for the dimensional stability of 
hardened steel gage blocks has led to the pursuit of 
other methods of obtaining suitable materials. Rolt 
mentioned development work in England in the 
1920's on unhardened gage blocks, coated with 
Stellite or electroplated iron or chromium. In more 
recent times development has been directed towards 
the use of stable carbides, such as tungsten or 
chromium, but these are considered to have an un- 
favorable coefficient of thermal expansion. Quartz 
single crystals have been considered frequently, but 
both the coefficient of thermal expansion and the 
thermal conductivity of quartz are too low to permit 
convenient use with most metals. 

3. Materials 

3.1. Requirements 

a. Dimensional Stability and the Structural Relationship 

Dimensional stability is a prime requirement for 
gage blocks, and stability is affected by structure 
and stresses within materials. All steels have a 
metastable structure when hardened to the 65 R c 
specified for gage blocks. As such there is a tend- 
ency for the structure (mosth r martensite) to reject 
carbon in the form of carbides and for the distorted 
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tetragonal lattice to become cubic. These proc- 
esses, one of the stages of tempering, occur with 
relative ease at elevated temperatures and with 
great difficulty and slowness at room temperature, 
but the forces promoting the decomposition of mar- 
tensite are present and can be expected to cause a 
reduction in volume of the gage block whenever a 
degree of decomposition occurs, no matter how 
slight. Hardened steel frequently contains various 
quantities of a second structural phase, austenite, 
which had failed to transform to martensite during 
the quenching and subsequent tempering operations. 
This phase is also metastable and can transform to 
martensite or bainite upon aging at room tempera- 
ture. Such a transformation contributes to an 
increase in volume, a growth of the gage block. 
Superimposed upon the possible structural changes 
are the dimensional changes caused by the relief of 
residual stresses. Residual stresses are present in 
hardened steel gage blocks as the result of at least 
three processes; those put into the block by the 
thermal gradients formed on heating and cooling, 
those formed as the result of structural changes, and 
those resulting from surfaces plastically strained in 
the fabricating processes. The relief of residual 
stresses can occur slowly at room temperature and 
can produce either a growth or shrinkage depending 
on the sign and orientation of the stresses. The 
ideal solution to the stabilization of a hardened steel 
block would be to treat it so that the shrinkage 4 
caused by the decomposition of martensite would 
be counteracted by the growth contributed by the 
transformation of austenite; and the balance of 
these changes compensated for in full by changes in 
the residual stress pattern. Such a solution is not 
belived entirely feasible with hardened steels, but 
with careful selection of suitable heat treatment and 
processing, it is hoped to reduce dimensional changes 
resulting from these factors to the desirable limits 
of 2XKr 7 in./in./yr. 3 

It was believed that the metastable structure 
alone was a severe deterrent to obtaining the degree 
of dimensional stability desired, and for that reason 
materials other than hardened steels were included 
in the prognm. Nevertheless, the wide usage and 
popularity enjoyed by hardened steel gage blocks 
precluded the omission of these materials, and 
efforts were directed towards improving their per- 
formance characteristics. 

A fully annealed steel is at or near its equilibrium 
condition. Provided all residual stresses are absent, 
it should be dimensionally as well as structurally 
stable. It was reasoned that a thin nitrided case 
applied to such a structure would produce an overall 
stable block with high surface hardness and wear 
resistance, even if the thin case should show some 
instability. The modulus of elasticity of steel is 
about the same whether the steel is annealed or 



3 The addition of a time factor to the tolerance is not normally done in gage 
block usage, since a tolerance is the maximum permissible variation from a given 
size. However, in a discussion of stability, where absolute stability may be 
unattainable, it is necessary to affix a time parameter. The time increment 
selected, one year, also implies that the gage block need not be calibrated at more 
frequent intervals than 1 year. 



hardened, and the support given by a steel to its 
nitrided case is the same whether that steel is an- 
nealed or hardened, provided the elastic limit of the 
annealed steel is not exceeded. For the extremely 
mild service for which these ultra stable gage blocks 
are intended, an annealed core should be ample. 
The same reasoning was applied to types of hard 
surfacing treatment other than nitriding, and several 
have been considered including flame plating with 
tungsten carbide or aluminum oxide, chromium 
plating, and thermal spraying with nickel-chromium 
boron alloy. 

b. Other Required Characteristics and Properties 

Several other characteristics and properties are 
necessary or desirable in addition to dimensional 
stability. A high degree of surface finish, flatness of 
surfaces, and parallelism of opposite faces are re- 
quired for precise measurements. These character- 
istics are related to the hardness and structure of the 
surfaces and their degree of development also de- 
pends on the skill of the final lappers. Ideally, the 
coefficient of thermal expansion, thermal conduc- 
tivity, and other thermal properties should he ap- 
proximately equal to those of high carbon steel. The 
necessity of this value of the coefficient of expansion 
is often misunderstood, and frequently materials with 
zero or very low coefficients have been recommended. 
In actual application, a laboratory grade of gage 
block is most frequently used to calibrate other high 
carbon steel gage blocks or tools by a comparison 
technique. Precise temperature control is essential 
and both the 4 gage block and the measured piece must 
he allowed to come to the same temperature. If 
there are very slight fluctuations in temperature or 
its measurement, similar coefficients may produce a 
compensation of the error. Otherwise the exact 
(luct nation and temperature as well as the exact 
coefficients involved must be known and appropriate 
mathematical computations made. With high car- 
bon steel, a temperature discrepancy of only 0.03° F 
is sufficient to change length by 2X10 -7 in. /in., 
which is equivalent to the desired maximum toler- 
ance being sought in this investigation. Other ther- 
mal properties are not generally considered important 
factors, but in the development of the measuring 
techniques, they were found to have considerable 
significance (see discussion in section 5). Surface 
hardness and wear resistance are related conditions, 
although the relationship may not be as direct as is 
customarily believed. However, it is easier to obtain 
a good lapped surface on a hard material than on a 
soft one, and a block that wears excessively will not 
maintain its size after repeated wringings. The 
ability to wring well is a necessary requirement. This 
characteristic is a function of the quality of the sur- 
face and it may be related to the material. Resist- 
ance to atmospheric and fingerprint corrosion is de- 
sirable not only from the standpoint of appearance, 
but because the build-up of oxide films on gaging 
faces may cause a change in length and will produce 
a deterioration in wringing ability. 
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3.2. Selection and Application 

The chemical compositions of the materials se- 
lected for investigation are given in table 1 ; the hard- 
ness values and available pertinent physical prop- 
erties are summarized in table 2. The materials can 
be divided conveniently into three groups as follows : 

1. Steels hardenable throughout by heat treat- 
ment— 52100 modified, W4, D2, and T15 modified. 

2. Steels readily amenable to surface hardening 
treatments— 1010, 8620, 304, 410, 420, 17-4 PH and 
Nitralloy 135. 

3. Materials other than steel — aluminum oxide 
and three forms of titanium carbide. 

Some of the steels of group 2 are also hardenable, 
but without additional surface conditioning the final 
hardness obtained is too low for a gaging surface. 

Several treatments have been applied to most 
of the materials. Thus, a total of 41 major com- 
binations of materials and treatments are being 
investigated (table 3). For example, 8620 steel has 
been both pack and liquid carburized and has been 
carbonitrided to give three combinations. In addi- 
tion there are some secondary variations in processing 



which are not reflected in the table, but are discussed 
later in the text or in an appropriate appendix. 
These consist of such items as differences in case 
thickness, grinding procedures, and in tempering or 
stress-relieving treatments. 

Experimental blocks of only two steels, 52100 and 
410 stainless, have been under observation for 
stability sufficiently long to have produced significant 
results. Data for these blocks were obtained from 
five major combinations on the 52100 steel and four 
on the 410 stainless. The 52100 steel was processed 
to produce five additional heat-treating variations, 
and one variation in grinding. Both directly 
quenched and martempered blocks were tempered 
to obtain a hardness of 65 R c and also 62 and 60 
R c , and one group was martempered in oil instead 
of NaNO.3 — NaN0 2 . One major combination on 
the 410 was also given a variation in processing. In 
those blocks receiving single stage gas nitriding, the 
cases on the nongaging faces of some were completely 
removed by grinding, whereas on others only the 
white layer was removed. All of the other materials 
are under observation or are in various stages of 
processing. Therefore, all further discussion will 
be limited to these two steels. 



Table 1. Designation and chemical composition of the materials selected for investigation 



Materials 


NBS 

desig- 
nation 


Chemical composition, percent by weight 




C 


Mn 


P 


S 


Si 


Cu 


Ni 


Cr 


V 


Mo 


Co 


W 


Ti 


Al 


AI2O3 


Cb 


Fe 


1010 


L 
W 

T 

E 

A 

F 

C 

D 

N 

P 

KA 
KB 

S 
V 

Q 


0.083 
1.00 
1.04 
0.20 
0.034 
0.15 
0.37 
1.51 
0.40 
0. 031 
11.2 
9.2 

6.8 
1.55 


0.42 
.44 
.68 
.80 
.4 
.36 
.34 
.28 
.60 
.34 


0.002 
.006 
.015 
.008 
.022 
.025 
.010 
.024 
.014 
.025 


0.023 
.011 
.013 
.012 
.014 
.008 
.013 
.005 
.011 
.005 


0.029 
.19 
.25 
.28 
.40 
.34 
.30 
.35 
.26 
.38 


0.13 
.074 
.23 
.12 
.16 
.13 
.05 
.08 
.14 

3.6 


0.075 

.18 
.15 
.50 
9.3 
.58 
.13 
.18 
.21 
4.3 

25.0 

40.0 


0.088 
.31 

1.44 
.51 
18.9 
11.2 
12.2 
13.5 

1.4 
16.4 


0.005 
.01 
.01 
.007 
.07 
.02 
.06 
.7 
.014 


0.01 
.045 
.27 
.19 
.10 
.13 
.1 
.54 
.34 






0.006 
.01 


0.057 
.01 






bal 


W 4 tool steel - ._ 










bal 


52100 mod 










bal 


8620 






.01 
.01 
.01 
.01 
.01 
.009 


.047 

.01 

.04 

.01 

.04 

.89 






bal 


304 stainless _ _ 










bal 


410 stainless 










bal 


420 stainless. __ ______ 










bal 


D2tool steel — __ 










bal 


Nitralloy 135 mod__ 










bal 


17-4 PH stainless. 










bal 


Titanium carbide A a 




5.0 
4.0 






52.0 
36.0 

29.12 






4.5 

4.5 


bal 


Titanium carbide B a 












3.0 

1.78 
4.5 








3.0 






Titanium carbide, steel 
binder.. _ _ 
















62.2 


T15 mod, tool steel __ 


.17 




.006 


.32 


.08 




6.0 


.5 


4.8 


14.4 








bal 


Aluminum oxide a __ __ __ 






100 









































a Nominal composition supplied by the producer; all others were analyzed at NBS 



Table 2. Hardness and pertinent physical properties of the selected materials 



Materials 



NBS 

designa 
tions 



Hardness, 
annealed or 
as received 



Density 



Modulus of 
elasticity 



Coefficient of thermal expansion 



Thermal conductivity 



1010 

W4 tool steel 

52100 

8620 

304 stainless 

410 stainless 

420 stainless 

D2 tool steel 

Nitralloy 135 mod 

17-4 PH stainless 

Titanium carbide A 

Titanium carbide B 

Titanium carbide, steel binder 

T15 tool steel 

Aluminum oxide 



L 
W 

T 



E 

A 
F 
C 

D 

N 

P 

KA 

KB 

S 

V 



56 Rb 
81 Rb 
81 Rb 



87 Rb 
70 Rb 
83 Rb 

93 Rb 
95 Rb 

94 Rb 
29 R c 
68 Rc 
72 R c 
37 R c 
98 Rb 

>70 R c 



lb/in.i 
0. 284* 



30X10* 



in./in./°F 

6.5X10'* (68 to 212°) . 

6.0 (68 to 212° ) 

6.3 annealed (85°)-- 

6.4 65 R c (85°) 

6.4 62 R c (85°) 

6.2 60 R c (85°) 

6. 6 carbonitrided (85°)- _ 

9.0 (85°). 

5.4 annealed (85°) 

5. 7 hardened (85°) 

5. 7 hardened (85°) 
6.5nitrided (85°) 

6. annealed (70 to 200° ) 

6.0 

5 3 

6. 8~6~(7~6 to'iado 5 )""". - - - 

5.4 (85°) 

3.0 (85°) 



Ptu/ftyin./sec/°F 
0.1112 (212°) 
. 0894 (212°) 



. 0313 (212°) 
. 0480 (212°) 
. 0443 (390°) 
.0482 (390°) 



. 0344 (300°) 
.0770 (212°) est. 
.0770 (212°) est. 



. 0497 (32 to 1020°) 



1 Ralics indicate values obtained from published data, or private communication with manufacturer. All others were obtained at NBS. 
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Table 3. Summary of treatments used for 


the selected materials 












NBS 

desig- 
nations 


Treatments 


Materials 


Harden 


Carburize 


Nitride 


Hard coat 






Direct 
quench, 

stabilize 


Mar- 
temper, 
stabilize 


Pack or 

gas, 
harden, 
stabilize 


Liquid, 
harden, 
stabilize 


Carbo- 
nitride, 
harden, 
stabilize 


Gas, 
one 
stage 


Gas, 
two 
stage 


Liquid 


Ther- 
mal- 
sprayed 
Ni-Cr-B 


Flame- 
plated 
tungsten 
carbide 


Flame- 
plated 
A1 2 3 


Electro- 
plated 
Cr 


As 
manu- 
factured 


1010 


L 
W 
T 
E 
A 

F 
C 
D 

N 
P 

KA&KB 

S 
V 

Q 






X 


X 


X 








X 
X 
X 






X 




W4 tool steel 


X 
X 


X 
X 








X 
X 


X 
X 




52100 














X 




8620 


X 


X 


X 










304 stainless .._ 






X 

X 
X 
X 
X 
X 




X 












410 stainless 












X 


X 


X 


X 


X 




420 stainless 


X 
X 














D2 tool steel 
















X 


X 


X 




Nitralloy 135 












X 






17-4 PH stainless 
























Titanium carbide A &B 
























X 


Titanium carbide, steel 
binder 


X 
X 


























T15 tool steel... 


























Aluminum oxide..- 
























X 































Type 52100 steel is being used in this program 
principally, but not in every instance, as a through- 
hardened steel (group 1). It was selected for a 
prominent place in the program because it is widely 
used as a gage block material and for many kinds 
of tools and precision devices. Preliminary harden- 
ability tests with a standard composition indicated 
failure to harden completely through with an oil 
quench in the size section required for this investiga- 
tion. To obtain improved hardenability, a 52100 
steel modified by the addition of 0.3 percent molyb- 
denum was specified. A few blocks of 52 100 were also 
employed in the annealed condition in an attempt to 
obtain improved stability and a coefficient of thermal 
expansion more favorable than that obtainable with 
the 410 stainless. A variety of hard coatings was 
applied to produce a suitable wear resistant surface. 

Stainless steel, type 410, is a martensitic type of 
stainless with relatively low hardness after harden- 
ing, but it possesses several properties of interest for 
gage block application. In the annealed condition 
it has essentially a single phased structure (except 
for spheroidal carbides) with its elements in solid 
solution. Its surface can be hardened by nitriding 
and it has good resistance to atmospheric corrosion, 
either when annealed or hardened. Its major ap- 
parent deficiency is a coefficient of thermal expansion 
reasonably close to but slightly lower than high 
carbon steel. Nitriding was the principal process 
used to harden the surfaces of the 410, but the other 
treatments indicated in table 3 were also applied. 

4. Procedures for Processing and 
Fabrication 

4.1. As Received Steels 

Each type of steel was obtained from a single heat 
and was commercially made in accordance with the 
accepted practices for that type, so that it would 
represent typical steels available on the market. 



With the exception of the T15 and 17-4 PH steels, 
each was hot rolled by the manufacturer into 
rectangular bars \){ in. X ){ in. After hot rolling 
and straightening, all bars were fully annealed by 
the manufacturer and precautionary measures taken 
to hold decarburization to a minimum. The gage 
blocks made from these bars were rectangular paral- 
lelepipeds with a gaging length of 2 in. and other 
dimensions of 1% in. X % in. 

The typical microstructures of the 52100 as an- 
nealed and after hardening and the 410 as annealed 
are shown in figure 1. 



4.2. Heat Treating of 52100 Steel 

With hardened steels, the difficulty of completely 
balancing the dimensional changes occurring from 
structural transformations against residual stresses 
can be minimized by keeping these factors at low 
levels. As a starting point, it was decided to elim- 
inate almost all of the retained austenite, which would 
reduce the possibility of growth and provide data on 
the stability characteristics of an austenite-free steel, 
and would possibly give a higher hardness and allow 
a higher tempering temperature or longer time at 
temperature to obtain a final hardness of 65 R c . The 
higher tempering temperature was considered bene- 
ficial in the reduction of residual stresses. The 
standard procedure used for hardening by direct 
quench was to austenitize at 1550° F for 15 min 
and quench to room temperature in a quenching oil 
having an accelerated cooling rate. 

The residual stresses resulting from thermal 
gradients on cooling from the hardening temperature 
are often reduced by martempering. The mar- 
tempering treatment adopted consisted of austeni- 
tizing in a chloride bath at 1550° F for 15 min, 
quenching in a sodium nitrate-nitrite bath at 300° F 
for 30 sec, and then quenching to room temperature 
in oil. 



179 

















\cf;.vr 



■g* 



^^ 



1 A h^^^ti^fe^^ 



yr 





m*M 









Figure 1. Microstructure of 52100 and J+10 stainless steel. X750 



A. 52100, annealed, etched with 1% Nital. 

B. 52100, hardened, etched with 1% Nital. 

C. 410 stainless, annealed, etched with hydrochloric -f- picric acids in ethanol 



Botli of the above hardening treatments were 
followed by a stabilization treatment designed to 
remove retained austenite, temper the martensite, 
and reduce residual stresses. This treatment for 
blocks hardened to 65 R c consisted of an immediate 
refrigeration at —140° F for an overnight period 
(18 to 22 hr), followed by a tempering treatment at 
250° F for 1 hr, a second refrigeration treatment at 
— 140° F for an overnight period, and a final temper 
at 250° F for 9 hr. The interval between steps was 
kept as short as possible. Details of the investiga- 
tion performed to establish this stabilization treat- 
ment as an optimum for the 52100 steel are given in 
appendix A. 

The temperature of the final temper was raised 
in some instances where a hardness of less than 65 
R c was desired. The prescribed hardness of 65 R c 
is believed to have been an arbitrary selection to 
obtain good wear resistance, and it was thought that 
a block with slightly lower hardness such as 62 or 
60 R c might be satisfactory from a wear standpoint 
and possess greater stability. Details of the heat 
and stress relieving treatments given individual 
blocks, and the final hardness of each, are shown in 
table 4. A stress relieving treatment was applied 
to all gage blocks after finish machining and prior to 
final lapping. 

4.3. Nitriding of 410 Stainless Steel 

The 410 stainless was the first of the group 2 ma- 
terials (steels readily amenable to surface hardening 
treatments) studied. The 410 steel was to be used 
in the annealed condition only, with the surface 
nitrided or otherwise hardened. The details of 
nitriding and stress relieving of each block are given 
in table 4. 

Tests were run to establish suitable procedures for 
nitriding this steel. No unusual techniques were 
required for effective nitriding. The surfaces of the 
blocks were prepared by grinding and thereafter 
were scrubbed in an aqueous detergent just prior to 
nitriding. A nitriding time of 40 to 44 hr at 1010 to 



Table 4. The heat treatment and hardness of gage blocks a 



Gage 

block 

no. 


Method of harden- 
ing 


Final temper, 
9 hr, ° F 


Stress relief, 
3hr, ° Fb 


Date of final 
stress relief 


Hard- 
ness 


T-301 
T-302 
T-309 
T-312 


Flame plate, 

tungsten carbide- 
Flame plate, 

tungsten carbide. 
Thermal spray, 

Ni-Cr-B. 
Thermal spray, 

Ni-Cr-B. 


Not applicable 
Not applicable 
Not applicable 
Not applicable 


975 
975 
975 
975 


May 1957 
May 1957 
July 1957 
July 1957 


72 

72 
62 
62 


T-314 
T-318 
T-337 
T-341 


Electroplate, Cr__. 
Electroplate, Cr__. 

Martemper 

Martemper 


Not applicable 
Not applicable 

250 e 

250 • 


400 (5hr) 
400 (5 hr) 

240 

240 


Jan. 1958 
Jan. 1958 
Jan. 1958 
Jan. 1958 


68 
68 
65 
65 


T-343 
T-344 
T-348 
T-351 


Direct quench 

Direct quench 

Direct quench ___ 
Martemper 


250 
250 
250 
350 


240 
240 
240 
340 


Jan. 1958 
Jan. 1958 
Jan. 1958 
Jan. 1958 


65 
65 
65 

62 


T-356 
T-357 
T-359 
T-369 


Martemper 

Martemper 

Martemper 

Martemper (oil) _ 


350 
450 
450 
250 


340 
440 
440 
240 


Jan. 1958 
Feb. 1958 
Feb. 1958 
Feb. 1958 


62 
60 
60 
65 


T-377 

T-378 
T-3S4 
T-386 


Direct quench 

Direct quench. _. 
Direct quench. .. 
Direct quench_-_ 


350 
350 

475 (23 hr) 
475 23 hr; 


340 (4 hr) 
340 (4 hr, 

465 (4 rr) 
465 (4 hr) 


May 1958 
Mav 1958 
May 1958 
May 1958 


62 
61 
59 
59 


F-302 


Nitride 


Not applicable d 


975 

975 
975 

975 


Mar. 1957 
Mar. 1957 
May 1957 

May 1957 


67 


F-305 


Nitride - 


70 


F-316 

F-317 


Flame Plate, 

tungsten carbide. 
Flame plate, 

tungsten carbide. 


72 
72 


F-322 
F-323 
F-325 
F-327 


Nitride, 2 stage 

Nitride, 2 stage 

Nitride, 2 sta^e 

Nitride, 2 stage 




975 
975 
975 
975 


Mar. 1957 
Mar. 1957 
Mar' 1957 
Mar. 1957 


67 
67 
65 
67 


F-330 


Nitride 




975 
975 
S75 
975 


Apr. 1957 
Apr. 1957 
Apr. 1957 
July 1957 


65 


F-333 


Nitride _ . 


69 


F-340 
F-349 


Nitride 

Nitride 


67 

72 


F-352 

F-358 
F-360 


Electroplate, Cr... 
Electroplate, Cr__. 
Nitride ._ 




400 (5 hr) 
400 (5hr) 

975 

975 

975 


Jan. 1958 
Jan. 1958 
July 1957 
July 1957 
July 1957 


68 
68 
67 


F-361 


Nitride _ 


69 


F-303 


Nitride.. . 


69 









a All gage blocks were nominally 2 in.Xl% m.XH in. 

b Stress relief was applied to all gage blocks after finish machining and prior to 
final lapping. 

c This value represents hardness of the case or coating where applicable. 
Where appropriate, hardness was measured with a micro tester such as the Vick- 
ers and converted to R c . 

d This applies from F-302 through F-363. 

e The lengtn of time held at final temper is uncertain. 
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1030° F produced a case about 0.009 in. thick. Dis- 
sociation of the ammonia was maintained at 20 to 25 
percent. As the result of nitriding, the blocks grew 
different amounts in each of the three directions; on 
the order of 0.0025 in. in the 2 in. dimension, 0.0020 
in. in the 1% dimension, and 0.0015 in. in the % in. 
dimension. 

The two stage Floe process was also employed in an 
attempt to reduce or eliminat e the white layer formed 
with conventional single stage nil riding. In this 
process, the first step consisted of nitriding for 20 to 
24 hr at 1000° F with a dissociation of 20 to 25 per- 
cent. Thereafter, the temperature of the retort 
was raised to 1050° F and cracked ammonia blended 
with the i in cracked ammonia to give a dissociation 
of 75 to 80 percent. The second stage was main- 
tained for about 24 hr. 

The micros tructures of a nitrided case produced 
by the single stage method are shown in figure 2. 
The hardness of the case nitrided by the single stage 
process exceeded 1260 KHN (Knoop Hardness 
Number, 200 g load) over its entirety. The hard- 
ness of the case produced with the two stage process 
was somewhat less than the case formed with single 
stage nitriding. Immediately adjacent to the surface 
the hardness was 880 KHN, the greater portion of 
the case had a hardness of 1020 KHN, and next 
to the core, hardness fell to 930 KHN (500 g loads). 
All of these values are appreciably greater than the 
minimum of 65 R c specified for gaging surfaces. 

In the grinding and lapping operations applied 
to the gaging surfaces after nitriding, approximately 
0.0025 in. was removed, which left from 0.006 in. 
to 0.007 in. of the case. The finish produced on the 
nitrided 410 blocks by commercial lapping is worthy 
of note. It was superior to finishes produced on 
hardened 52100 steel, but took about one third more 
time for the removal of equivalent amounts of stock. 
The final microfinish, as measured with a tracertype 
surface roughness instrument, closely approached 
zero. Wringing characteristics were excellent. An 
interferogram of the surface of one of these blocks 
and a photograph of the surface of another is shown 
in figure 3. There was a sharp interface and an in- 
termediate zone of nitrogen diffusion between the 
case and the core (fig. 2), which was unlike the grad- 
ual blending associated with the nitrided case of 
Nitralloy. This 'type of interface is generally be- 
lieved to be a plane of weakness in the steel and a 
region where sp ailing can occur easily. After re- 
moval of the white layer, several blocks were sub- 
jected to rough handling, including severe grinding 
and impact deformation of lapped surfaces, and no 
sp ailing occurred. The mild mechanical service to 
which this type of gage block should be subjected 
further reduces the possibility of trouble from 
spalling. 

The corrosion resistance of the case is different 
from that of the original steel. As can be seen from 
the microstructure in figure 2, dilute nitric acid and 
Vilella's reagent attack the nitrided layers more 
readily than the ferritic matrix. On the other hand, 
the nitrided surfaces arc less subject to coating by 
tinted surface films in such processes as stress reliev- 



ing in a cracked ammonia atmosphere. Nitrided and 
lapped surfaces with no protective wrapping, oil or 
wax film, or other corrosion preventive treatments 
have been exposed for two years under normal indoor 
conditions of humidity and temperature in the atmos- 
phere of Washington, D.C., and have shown no 
tendency to become dull or to rust. 

The single stage nitriding treatment was applied 
to two series of blocks that were fabricated differently 
after nitriding. In one series the nitrided layer was 
completely removed from the four nongaging faces 
by grinding parallel to the 2 in. dimension. In the 
other series, only about 0.002 in. was ground from 
each nongaging surface so as to produce a bright 
nitrided finish. The first series, as a result, was 
finished with nitrided cases on the two gaging faces 
only, while the second series had nitrided cases all 
over. 

In a third series, the blocks were nitrided by the 
two stage process, and the four nongaging surfaces 
were not ground or otherwise disturbed after 
nitriding. 

4.4. Hard Coatings 

Both the 52100 and the 410 stainless were coated 
with hard-facing materials in four different ways: 
1, Thermal spraying with a nickel-chromium-boron 
alloy; 2, flame plating with tungsten carbide; 3, 
flame plating with aluminum oxide; 4, electro- 
plating with chromium. In each instance the base 
material was in the annealed condition. The stability 
of the 410 stainless thermally sprayed with nickel- 
chromium-boron is not reported in this paper because 
the blocks required additional shortening and the 
final lapping has not been completed. No report is 
made on these two steels flame plated with aluminum 
oxide because of the difficulties of obtaining a good 
interferometric fringe pattern on this surface. The 
same difficulties were not experienced on blocks of 
solid aluminum oxide incorporated into the measuring 
program at a later date. Details of each coating and 
the methods of application are given in appendix B. 
Subsequent stress relief treatments and the final 
hardness of each coating are given in table 4. 

4.5. Fabrication 

The hardening and stabilization of the 52100 steel, 
the nitriding of the 410 stainless, and the chromium 
electroplating were carried out in laboratories of the 
National Bureau of Standards. Thermal spraying 
of nickel-chromium-boron alloy and flame plating 
with tungsten carbide were applied by commercial 
firms. All machining operations except lapping were 
performed in the Bureau's machine shop. Lapping 
was done b}^ several commercial firms 4 in accordance 
with the best commercial practices. The procedures 
for grinding and other details of fabrication are given 
in appendix C. Considerable care was exercised in 
fabricating these blocks and recording the details 
thereof, because of the potential significance attrib- 
uted to residual stress patterns induced bv these 
processes. 

DoAll Co., and Pratt and 



4 Brown & Sharpe Co., Dearborn Gage Co. 
Whitney Co., Inc. 
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Figure 2. Microstructure of nitrided 410 stainless steel. 



Dual etch: 1% Nital followed by Vilella's Reagent. 

A. 1. White layer; 2. Nitrided case; 3. Intermediate zone; 4. Core; X250. 

B. Case. White layer is at the top and appears gray with etchants used. X1000. 

C. Intermediate zone and core. X1000. 
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Figure 3. Nitrided surfaces on initially annealed J+10 stainless steel. 



A. Interferogram (courtesy the DoAll Co.). The interference fringe interval is about 250 m/x. 

B. Reflection fr( m mirror-like surface. The form of chart has no significance other than to provide an image for reflection. 



5. Metrology 
5.1. Development of the Measuring Technique 

The measurement phase of the stability program 
required a testing technique that would provide 
frequent measurements of a large number of test 
samples and precision of length measurement on the 
order of 2 parts in 10 million. 

The degree of precision would del ermine the time 
interval required to acquire significant data indi- 
cating change of length of the test samples. Fre- 
quent measurements would provide information on 
the nature of the change. As the test samples are 
2 in. in length, a practical limitation to the error of 
measurement of 0.4^ in. was established as a goal 
(0.2^ in. /in.). 

To establish the change in length of the test 
samples it was necessary to define a length scale 
whose stability characteristics were known. An 
ideal procedure would be to compare the sample 
with a length scale formed by the interference of 
light of known wavelength. It is generally believed 
that a wavelength of light, X, is constant in time 
and may be expressed by 

where c is the velocity of light in vacuum, 

a is the index of refraction of the material 

through which the light is transmitted, 
v is the frequency of light radiation. 



Procedures and instrumentation are available that 
provide such absolute measurements of the test 
samples [14]. Although the Bureau is now engaged 
in the development of procedures and instrumenta- 
tion to achieve precision in such absolute measure- 
ments to 1 or 2 parts in 10 million, the best that 
could be done when the stability program was initi- 
ated was 1 part in 1 million. 

The precision of such measurements is limited by 
the differing effects of temperature on the sample 
and the interference scale formed in the air sur- 
rounding the sample. The index of refraction of air 
is dependent upon temperature, so from the equation 
it is observed that the wavelength of light is depend- 
ent upon temperature. For visible light in an ap- 
proximate standard atmosphere (760 mm Hg, 68° F), 
the wavelength scale might be considered as having 
a coefficient of expansion approximately }io that of 
steel, which was the material used for most of the 
stability samples. In addition, problems are en- 
countered if the temperature of the measurement 
area is not stable. Because of thermal lag, the 
temperature of the air in which the wavelength scale 
is formed will, in general, be different than the tem- 
perature of the sample. For example, Evans [15] 
reports the thermal lag time of a polished iron 
cylinder of 2 cm diam immersed in air to be 2,000 
sec, causing the axial temperature of the rod to 
differ from air by 1.0° F when the temperature of 
the air is increasing 1.8° F per hour. Thus the 
relationship between the sample and the wavelength 
scale is critically dependent upon temperature, and 
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the effective temperature of the sample can he diffi- 
cult to determine as the axial temperature of the 
sample is likely to differ from its surroundings. 

One method of avoiding difficulties of this nature 
is to resort to comparison measurements where the 
length of the test sample is compared with a standard 
length having thermal properties similar to those of 
the sample. A specially designed optical interference 
comparator [16] of a type originally developed by 
Rosters [17] was available that could be relied upon 
to provide precision to approximately 1 part in 10 
million. As most of the test samples were steel 
blocks 1% in.X/s in.X2 in. long, it was considered 
highly desirable to select as a standard of length a 
steel gage block with the same cross sectional size 
and nominal length and having a long history of 
absolute length measurements to indicate stability. 

Absolute measurements made at irregular periods 
since January 1954 on a 2 in. steel gage block serving 
as a length standard for the NBS Engineering Metrol- 
ogy Section indicated it to be exceedingly stable. 
The curve best fitting the measurement data indi- 
cated that its growth had not exceeded 0.2 fx in. 
since the measurement series began. This gage block 
was chosen as the basic reference length for the 
stability measurement program. Since the initia- 
tion of the program this block has been subjected 
to more frequent absolute length measurements. 
These recent measurements continue to justify its 
choice as a stable standard. 

The difficulty encountered in using the interference 
comparator as the measuring instrument was an 
insufficient testing capacity to measure all the test 
samples as frequently as desired. For test samples 
of 2 in. length, a minimum time of 4 hr is considered 
necessary between the operation of wringing the 
test specimen to the platen and the comparison of 
this specimen with the master gage block. This 
interval is believed necessary to allow the test 
specimen to attain thermal equilibrium with the 
master block and to allow the wringing film to attain 
its minimum thickness in case more wringing lubri- 
cant is used than is necessary. During this time 
interval, it is necessary to maintain the platen in the 
location occupied during the measurement. Thus, 
the need for this time interval limited the test capac- 
ity of the interferometer. 

During the initial months of investigation of any 
specimen, it was desired that its length be determined 
weekly. Thus it was foreseen that a test program 
having a capacity of 50 measurements a week was 
required. The classical methods of precise length 
comparison rely upon the comparison of static lengths 
and are time consuming because they require thermal 
equilibrium. The most apparent solution to the 
problem of increasing test capacity was to abandon 
the concept of static length comparisons and replace 
it with the concept of dynamic length comparisons. 
In general, such comparisons had not been replied 
to a degree giving the precision that was required. 
It was questionable whether the instrumentation 
usually employed in such comparisons would provide 
the necessary repeatability. 



Figure 4 indicates schematically a typical mechan- 
ical comparator employed in dynamic length com- 
parisons. The measuring styluses are mounted in 
reed spring systems to avoid binding that could be 
encountered in piston-cylinder arrangements. A 
core of a moving core transducer is mounted on each 
stylus. A moving core transducer consists of a 
primary coil and two oppositely wound secondary 
coils. The relative potential induced in each 
secondary is dependent upon the position of the core. 




TRANSDUCER CORE 
PRIMARY COIL 

SECONDARY COILS 

MEASURING STYLUS 
TEST BLOCK 

ANVIL 

MEASURING STYLUS 

REED SPRINGS 



Figure 4. Elements of a mechanical comparator of lengths. 



Thus, the position of the stylus is indicated. 
Amplification of the signal is provided so that de- 
flection of the milliammeter needle magnifies move- 
ment of the stylus by approximately 2 X 10 5 . In 
this instrument the top and bottom transducers 
provide opposing signals of equal magnitude so that 
effects of translation of the test piece in the direction 
of its critical length are cancelled in the combined 
signal. This reduces the need for extremely critical 
seating of the test piece on the anvil. Comparison 
of length is accomplished by noting the difference in 
readings of the calibrated scale as the test pieces are 
successively positioned between the measuring 
styluses. This type of comparison is referred to in 
this paper as a dynamic comparison because of the 
handling and transportation of the test piece just 
prior to the measurement, which in general, will cause 
growth or shrinkage due to change of thermal con- 
ditions. Attempts are usually made to control these 
thermal changes within practical limits. 

In determining whether or not this type of length 
comparison would provide the precision necessary for 
the stability measurements, it was necessary to 
distinguish errors in comparison caused by lack of 
control of the dynamic effects from those due to the 
inherent randomness of the measuring instrument. 
The former could possibly be reduced to within 
acceptable limits, whereas the latter would establish 
the limit of precision that could be obtained with 
available instrumentation. 

An indication of what might be expected in inher- 
ent randomness of the mechanical comparator was 
obtained in an acceptance test conducted when the 
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instrument was purchased. This test measured the 
relationship between the meter reading and the 
pressure exerted by the measuring stylus, and 
avoided the effect from dynamic changes mentioned 
as it is independent of length. The results indicated 
that the inherent randomness of the instrument 
might possibly be limited to 0.5 y, in. in comparisons 
of length. If this magnitude was a true indication 
of the instrument's potential performance in length 
comparisons, it was considered possible to achieve 
the desired precision provided thermal effects could 
be controlled to effectively eliminate or nullify the 
dynamic changes in length of tin 4 test specimens. 

5.2. Concepts Applied in the Measurement 
of Dynamic Length 

To effectively eliminate the dynamic changes, the 
comparison of test specimens would be required 
under temperature conditions that restricted temper- 
ature variation of the specimens to less than 0.02° F. 
This seemed impractical. An approach to the prob- 
lem was selected that attempts to nullify the dynamic 
changes in the comparison. It was reasoned that 
if test specimens to be compared could be treated 
identically during the comparison and if the speci- 
mens responded to thermal variation in an equal 
manner, dynamic changes of length could be nullified. 
Therefore the test specimens were divided into 
groups, all blocks in a group having similar thermal 
properties. One block of each group was selected 
as a secondary master. As the secondary masters 
would in genera] have different thermal charac- 
teristics than the primary master block, it was 
planned to compare the secondary masters with the 
primary master by using the interference comparator 
The secondary masters would then be used in dy- 
namic comparisons with test specimens of their 
respective groups using the mechanical comparator. 

Traditionally the secondary master would be 
compared with each test specimen in i(s group. 
This technique, however, gives special emphasis to 
the test specimen that was designated as a secondary 
master and thus violates the requirement of equal 
handling of all test specimens to nullify dynamic 
changes occurring during the comparisons. A more 
appropriate comparison system is one that has been 
used at NBS for the comparison of line standards 
of length with the national standard of length [18]. 



In this system, the master is handled as one of the 
test specimens of a group. All possible comparisons 
of specimens within the group are made to form one 
intercomparison test. If the group consists of n 
specimens, n(n-l) comparisons are made of n(n-l)/2 
pairs. For example table 5 indicates the compari- 
sons to be made of a group containing four specimens, 
the secondary master A and test specimens B, C } 
and D. 

A possible method of reducing the data is to sum 
the columns and divide by the number of specimens 
in the group; e.g., (s/4). 5 This provides an average 
length of the specimen represented by the column 
relative to an average length of specimens within 
the group. The final results are obtained by form- 
ing all differences of column footings; i.e., the length 
of any specimen within the group relative to the 
length of any other specimen within the group is 
determined. Thus the lengths of B, C, and D can 
be determined relative to the length of the secondary 
master .1 and equal handling of all blocks of the 
group can be maintained. Each final result (dif- 
ference in column footings) is then subtracted from 
the appropriate direct measurement; e.g., the column 
footing of B minus the column footing of A is sub- 
tracted from the actual measured comparison B—A. 
This provides a residual. A group of n test speci- 
mens provides n(n— 1) residuals that may be used 
to evaluate the precision of the results of an inter- 
comparison test which consists of n(n—\) compari- 
sons. 

Conventionally, the sum of the squares of the 
residuals is determined and the probable error or the 
standard deviation computed. A multiple of this 
value is considered to represent a limit to be assigned 
to the test result. A prediction is made that a cer- 
tain percentage of repeated tests of the same speci- 



6 The usual statistical approach is to Immediately reduce the measurement 
data by a least squares method which involves averaging the data obtained in 
the two measurements involving a given pair. Then the value appearing below 
the diagonal is the mirror image of the value of the reverse comparison appear- 
ing above the diagonal. This provides greater precision in the result as it em- 
ploys all measurement data Involving a given specimen in evaluating its result. 
However, this procedure can mask the presence of bias such as drift. In the 
initial development of the measurement technique, precision of results was of 
secondary importance to the Information concerning systematic errors that could 
be derived bv analysis of the spread of the actual comparisons. By initially 
employing the method of data reduction shown in table"), the characteristics of 
the drift error were more apparent and a decision could be made as to whether 
particular measurement sequences, which are sometimes inconvenient, were re- 
quired. In section 5.3. and appendix D, an evolution from this simple program 
to the employment of least squares solution and the type of measurement se- 
quence Anally utilized is described. 



Table 5. Comparisons performed in an intercomparison test on a group containing four specimens 





A 


B 


C 


I) 


A 

B 

C. 

D 


* 
A-B 
A-C 
A-B 


B-A 

* 

B-C 
B-D 


C-A 
C-B 

* 

C-D 


B-A 
D-B 
B-C 

* 


2 

2/4 


4 A- (A+B+C+D) 

A (A+B+C+D) 
A 4 


4B- (A+B+C+D) 

p (A+B+C+D) 
4 


W- (A+B+C+D) 

„ (A+B+C+D) 
4 


4D- (A+B+C+D) 

D (A+B+C+D) 
4 
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mens, using the same measuring technique and 
equipment, will provide a similar test result within 
plus or minus this limit. For instance, it is usually 
accepted that three times the standard deviation 
will provide a limit within which 99.7 percent of the 
test results of a given specimen will be similar. This, 
in general, is a fallacy as such a condition depends 
upon the residuals being centered on zero and having 
a normal or Gaussian distribution. 

Therefore, to obtain a better insight of the prob- 
able precision of the results of an intercomparison 
test and to possibly diagnose the type of measure- 
ment error occurring during an intercomparison test, 
it was decided to plot frequency distributions of the 
residuals, i.e., the magnitude of each residual plotted 
against the number of occurrences. It soon became 
evident that these distributions could serve as a 
powerful tool in the development of a satisfactory 
measuring technique. First, they allowed for a 
better estimate of the meaning of calculated prob- 
able error or standard deviation in regard to the 
precision of the results of an intercomparison test. 
Second, they indicated the success achieved in elim- 
inating bias from the comparison procedures and 
indicated whether this success was temporary or was 
consistent in repeated intercomparison tests. Third, 
they served as a basis for hypothesizing the source 
of error and then served to indicate the effects of 
test refinements introduced in attempts to eliminate 
or nullify these sources. 

The general procedure used in refining the com- 
parison techniques was first to hypothesize from the 
residual distribution the nature of the systematic 
and random error. Then, when possible, the se- 
quence of the comparisons was changed in an attempt 
to nullify the systematic error in the final results. 
When successful, a truer picture of the nature of the 
systematic error was obtained from the frequency 
distribution of the residuals. Attempts were then 
made to eliminate the systematic error from the 
comparisons until a random distribution of residuals 
was indicated. Even if systematic errors are nulli- 
fied in the final results there is an advantage in elimi- 
nating the systematic errors from the individual 
comparisons. This can be accomplished by modifi- 
cation of the test procedure or fixtures in such a way 
as to eliminate the hypothesized systematic errors, 



or in some cases can be accomplished by variation in 
the treatment of the data; e.g., employing a least 
squares solution in the data reduction. When more 
random distributions are obtained as a result of such 
action, it not only verifies the hypothesis of the sys- 
tematic error but provides frequency distributions 
of residuals that can more adequately indicate the 
origination of new systematic error in succeeding 
intercomparison tests. An example of this type of 
approach in the refinement of the testing technique is 
treated in appendix D. 

First, with ten specimens and then with eleven in 
an intercomparison group, the comparison sequences 
were changed and, where indicated by frequency dis- 
tributions, modifications were made in handling of 
the test specimens and in the test fixtures. Section 
5.3. contains some specific examples of such refine- 
ment and includes some examples of frequency dis- 
tributions obtained during the development of the 
testing technique. Figure 5 indicates typical fre- 
quency distributions obtained during the initial (fig. 
5A) and more advanced (fig. 5B) phases of the de- 
velopment of a satisfactory measuring method for the 
stability project. 

5.3. Statistical Control 

One of the important features in the development 
of the measurement method was the use of the results 
of statistical analyses of the data to guide the evolu- 
tion of a measuring technique. The measuring tech- 
nique and the least squares method of data reduction 
finally employed actually evolved from a series of 
modifications in procedure and equipment made on 
the basis of information obtained from the statistical 
analyses. This statistical approach was then further 
utilized as a control in monitoring the measuring 
technique to insure continuing uniformity. 

A number of examples illustrate such utilization 
of these statistical analyses in the stability measure- 
ment program. The first of these involves a modifi- 
cation of the comparison schedule (order in which the 
110 comparisons which make up an intercomparison 
test are performed) based on information obtained in 
the statistical analyses of the data. Utilizing the 
method of computation illustrated in table 5, the 
frequency distributions of the residuals in some of 
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Figure 5. Example of frequency distributions of residuals obtained in two intercomparison tests. 

A. Typical distribution obtained from an intercomparison test conducted during the initial development phase of the measuring technique. 

B. Typical distribution obtained from an intercomparison test conducted during a more advanced development phase of the measuring technique. 
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of the early intercomparison tests in the program 
showed that the medians of these distributions were 
located at some point other than zero. This indi- 
cated a systematic error or drift which caused the 
system to quite consistently give either a larger or a 
smaller reading on each successive insertion of a 
sample into the comparator. 6 An example of a dis- 
tribution evidencing such a condition is shown in 
figure 6 where the median of the distribution is in- 
dicated by the arrow. This particular distribution 
obtained in one of the early intercomparison tests 
indicates a drift of three 10-millionths of an inch. 




-1.0 -0.5 0.0 

MAGNITUDE OF RESIDUALS, fj, in 

Figure 6. Frequency distribution of residuals obtained from 
an intercomparison test showing the presence of a drift effect. 
Arrow indicates median of distribution. 

To understand why the detection of this drift effect 
through statistical analysis of the data led to a change 
in the comparison schedule, it should be noted that 
there are two possible comparisons between any two 
sample blocks. Thus if the two blocks are block A 
and block B, the two comparisons would be block B 
against block A and block A against block B. The 
B against A comparison is made by placing block A 
in the comparator, obtaining a scale reading, and 
then placing block B in the instrument and again 
noting the scale reading. Subtracting the reading 
on block A from that on block B gives the result of 
the first comparison, block B minus block A. 
Similarly, the second comparison results in block A 
minus block B. Now, however, if the drift effect 
causes the system to give a larger or smaller reading 
on each subsequent block, it is quite evident that the 
first comparison results not in block B minus block A ) 
but in block B minus block A plus a drift factor 
which is either positive or negative. Similarly, the 
second comparison gives block A minus block B plus 
a drift factor. The first effort to overcome this drift 
was an effort to insulate the final results of the inter- 
comparison test from the drift effect. If the drift 
was constant in time, it would, in fact, be a constant 
error and would be nullified automatically and not 
affect the final results. (See footnote 13, appendix 
D.) Its effect on each measurement which would 
appear in the residuals could also be eliminated by 
employing a least squares solution in reducing the 
measurement data. This involves the following 



6 Employing the method of least squares solution in the reduction of the data 
would force the medians of the frequency distributions of residuals to zero and 
could reduce and possibly distort the indication of drift shown by the residuals. 



averaging procedure 4 applied to the measurement 
data before the columns are summed. Consider again 
blocks A and B and let them have actual lengths 
a and b respectively. Let the drift effect contribute 
a variation in the length determinations of an amount 
aAt. Tli en the first comparison gives as a result 
(b — a+aAt) and the second comparison gives 
(a— b + aAt). Now if the result of the second com- 
parison is subtracted from that of the first, and this 
quantity then divided by two, the drift effect is 
eliminated and for the first comparison the adjusted 
observed result, (b—a), can be substituted. Similarly 
the negative of this, (a—b), is obtained as an adjusted 
observed result for the second comparison. 

On detection of this drift effect, such a least squares 
solution was quickly introduced into the data 
processing. However, at the time this drift was 
detected, the comparison schedule then employed 
called for a considerable lapse of time between the 
first and second comparisons on each pair of blocks. 
It was then thought quite possible that the drift 
would in general be a nonlinear function with respect 
to time, and in this case, of course, the least squares 
procedure would be ineffective in eliminating the 
influence of the drift effect upon the residuals. In 
addition it was believed that a more appropriate 
schedule of comparisons could be used to effectively 
eliminate such a nonlinear drift from the results of 
the intercomparison tests. For this reason, the com- 
parison schedule was modified in such a way as to 
follow the form shown in appendix D, table 10. This 
schedule was in turn modified to follow the form 
shown in appendix D, table 11 when it was recognized 
that successive comparisons of a pair of blocks could 
cause inhomogeneous comparison data. Thus the 
detection of the drift effect through statistical 
analysis led directly to a modification in the measure- 
ment program. 

The statistical analyses of the data resulted in a 
number of other modifications of the measuring 
technique which are not here included, but an 
example of how a modification in the actual handling 
of the sample blocks resulted from information 
obtained in the statistical analyses might be illustra- 
tive. As was indicated above, the measurement of 
dynamic length depends to a very great extent on a 
symmetry of handling of the samples being measured. 
The symmetry of handling employed in the stability 
measurements evolved largely from consideration of 
the statistical controls. At an early stage in the 
development of the measuring technique here em- 
ployed, it had been determined that in making the 
two comparisons between any pair of blocks it was 
necessary to physically handle the two blocks 
together as a pair rather than individually. Thus, 
in making the comparisons the two blocks involved 
in any two comparisons would be picked up together 
with the gloved hand and placed in the comparator. 7 



7 When it was realized that blocks were to be handled in pairs, it was decided 
to employ, if possible, the operator's hand as a tool to convey the blocks through 
the comparison procedures. Other tools, such as tongs, introduced too great a 
possibility that mechanical shock, because of accidental dropping, would be 
introduced as an uncontrolled factor affecting stability. To minimize thermal 
effect, cotton flannel gloves were used. 
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The first and then the second comparison would be 
made and the blocks then returned as a pair to the 
storage area. Such a handling procedure, it was 
believed at the time, resulted in the two blocks in any 
comparison receiving equal, symmetrical handling. 
Examination of the residual frequency distributions 
obtained at this time, however, indicated that the 
manner in which the blocks were held in the gloved 
hand had a significant effect on the residuals of the 
intercomparison tests. At the time this effect was 
noticed, the blocks were being held as illustrated in 
the upper portion of figure 7 with one block of the 
pair exposed to the palm of the glove insulated hand. 
The residual distribution obtained in an intercom- 
parison test in which this handling technique was 
emplo^yed is shown in figure 8. It should be noted 
that the total distribution is plotted at the bottom 
of the figure, and this distribution is then broken 
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Figure 7. 



Manner of handling two gage blocks for comparison 
measurement. 



Top — Handling thai produced asymmetrical thermal effect. 
Bottom— Modification employed to correct asymmetrical condition. 
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Figure 8. Frequency distribution of residuals obtained in an 
intercomparison test. 

Handling introduced asymmetrical thermal effects as shown by separation of 
medians. 
Top— Distribution obtained from second comparisons of pairs of gage blocks 
Center— Distribution obtained from first comparisons of pairs of gage blocks' 
Bottom— Total distribution of residuals. 

down into the two distributions shown in the upper 
portion of the figure. The distribution of residuals 
resulting from first comparisons between each pair 
of blocks is shown in the central plot, while that 
obtained from second comparisons is plotted at the 
top of the figure, It can be seen that the medians of 
the first and second comparison distributions, shown 
by the arrows, are not alined, but are separated by 
seven 10-millionths of an inch. 

The asymmetry suspected as the cause of the split 
between the medians of the first and second com- 
parison distributions shown in figure 8 was in the 
handling of the blocks; one block was exposed to the 
palm of the gloved hand while the other block was 
not so exposed. This can be seen in the illustration of 
the handling technique at that time employed, as 
shown in the upper portion of figure 7. This 
suspicion led to changing the manner in which the 
blocks were held to that shown in the lower view of 
figure 7. When this handling technique was em- 
ployed the residual distribution shown in figure 9 was 
obtained. Here, the medians of the first and second 
comparison distributions are separated by only one 
10-millionth of an inch indicating that the asym- 
metry has been sharply reduced. This shows how 
the use of the statistical controls led to a modification 
of the actual handling techniques employed. 

One further example of the application of statisti- 
cal control to the intercomparison tests will illustrate 
how statistical analyses can be effectively used to 
monitor the measuring technique and detect break- 
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Figure 9. Frequency distribution obtained from an inter- 
comparison test when handling was modified to correct asym- 
metrical condition. 

Close alinemenl of the medians shows absence of asymmetrical condition. 
Top— Distribution obtained from second comparisons of pairs of gage blocks. 
Center— Distribution obtained from first comparisons of pairs of Rage blocks. 
Botton —Total distribution of residuals. 



downs in the technique which might not otherwise 
be evident. 

After a series of modifications in technique finally 
resulted in the development of a satisfactory inter- 
comparison procedure, this procedure was employed 
on all the intercomparison tests and regularly gave 
residual distributions comparable to that shown in 
figure 9. Then, after a considerable number of 
intercomparison tests had been run using this 
procedure, the residual distribution shown in figure 10 
was obtained. This again indicates, by the split 
between the medians of the first and second com- 
Darison distributions, that an asymmetry was present 
during this particular intercomparison test. A similar 
asymmetry was evidenced in the residual distribu- 
tions of succeeding intercomparison tests indicating 
that some breakdown in the system had occurred. 
Careful examination revealed that actually there had 
been an asymmetry in the comparison procedure all 
along but that its effects had been eliminated from 
the earlier intercomparison tests by other precau- 
tions, and that these precautions had now broken 
down causing the asymmetry to be revealed. As 
indicated above, the gage blocks during comparison 
were always handled in pairs and gloves were 
employed for this handling to insulate the blocks, to 
a certain extent , from the hand. To get the two 
blocks of a pair together, since the blocks were 
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Figure 10. Frequency distribution of residuals obtained in an 
intercomparison test when a breakdcion of test fixtures activated 
a dormant asymmetry in technique. 

Separation of distribution medians shows the presence of an asymmetrical 
condition. 
Top— Distribution obtained from second comparisons of pairs of gage blocks. 
Center — Distribution obtained from first comparisons of pairs of gage blocks. 
Bottom— Total distribution of residuals. 



spread out on a storage area, it was necessary to 
pick up first one block and then the other. Thus, 
the first block picked up was given more time to be 
affected by the handling before its measurement 
than was the second block and this is an asymmetrical 
condition. The gloves had been used from the start 
to minimize the effects of handling, but at the time 
this asymmetry was detected, it was noticed that 
the gloves employed had become worn and impreg- 
nated with foreign material. It was suspected that 
in this condition the effectiveness of the gloves in 
shielding the comparisons from the asymmetry 
involved in picking up the blocks one at a time was 
reduced. 

To determine whether this was indeed the case, 
the handling technique was modified in the following 
way. In previous tests, the gage blocks had been 
picked up one at a time from the storage area and 
placed on a loading stage so that the pair could then 
be picked up together for the comparisons. This 
procedure was modified by using a pair of tongs to 
pick up the blocks one at a time from the storage 
area and place them on the loading stage. The tongs 
were then put aside and the pair of blocks were 
picked up together from the loading stage as before, 
with the gloved hand. The comparisons w^ere then 
made just as before. 

This modification of the handling technique 
removed the gloved hand from the asymmetrical 
initial portion of the handling procedure and hence 
if the sudden appearance of the asymmetrical 
condition was due to the failure of the gloves, the 
asymmetry should have been eliminated with this 
modification. That this occurred is illustrated by 
figure 11 which shows the residual distribution 
obtained when the tongs replaced the gloved hand 
in the initial asymmetrical portion of the handling- 
procedure. This modified technique was then 
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Figure 11. Frequency distribution of residuals obtained in an 
inter comparison test when modification in test fixtures was 
introduced to correct an asymmetrical condition. 

Close alinement of the medians shows absence of asymmetrical condition. 
Top — Distribution obtained from second comparisons of pairs of gage blocks. 
Center — Distribution obtained from first comparisons of pairs of gage blocks. 
Bottom— Total distribution of residuals. 



adopted for all subsequent intercomparison tests, but 
this example illustrates how statistical control was 
employed to detect a breakdown in the technique 
and indicates the value of continuing to employ such 
control as a monitor of the measurement method. 

This type of statistical control is, however, ineffec- 
tive as a monitor in detecting certain types of non- 
uniformity in the measuring method. In particular, 
it will not detect variation in measurement technique 
which results in a change in the relationships between 
lengths of the blocks of an intercomparison group 
when these changed relationships continue through- 
out the time interval of one complete intercomparison 
test. An example of this type of variation in pro- 
cedure occurred during the testing of one intercom- 
parison group of gage blocks. Intercomparison tests 
had been run on this particular group for a period 
of several months. The regularly employed pro- 
cedure was used in each intercomparison test, but on 
the date of one test an interferometric measurement 
of one block in the group was planned for the same 
date on which an intercomparison test was to be run. 
The normal procedure for an intercomparison test 
called for the eleven blocks in the group to be placed 
on the storage area of the intercomparison test equip- 
ment the night before the intercomparison test was 
to be run and left there overnight until the test was 
begun in the morning. The normal procedure for 
the interferometric measurement called for the plac- 
ing of the block to be measured in the interferometer 
the night before the measurement was to be made. 
However, since the interferometric measurement of 
the one block in this set would only take a few min- 
utes in the morning before the intercomparison test, 



it was decided to proceed with the interferometric 
measurement and the intercomparison test both on 
the same day. Thus the block to be measured inter- 
ferometrically, the F302 block, was placed in the 
interferometer the night before the date of the two 
tests and left there overnight, while the other 10 
blocks in the group were placed on the storage area 
of the intercomparison test equipment and left there 
overnight just as the normal procedure required. 
In the morning, the F302 block was measured inter- 
ferometrically and was taken from the interferometer 
and placed on the storage area with the other 10 
blocks, a horizontal movement of approximately 
6 ft within the constant temperature room. An 
hour later the intercomparison test was begun fol- 
lowing the normal procedure and this test took per- 
haps 4 hr. Calculation of the data and plotting of 
the residual distribution gave the distribution shown 
in figure 12, which shows an excellent distribution. 
However, when the relationships between the F302 
block and the other blocks in the group were ex- 
amined, the results of this intercomparison test ap- 
peared anomalous. This is illustrated in figure 13, 
where the differences in length are plotted for the 
following blocks: F323 minus F302, F327 minus 
F302, and F330 minus F302. These data were deter- 
mined in successive intercomparison tests on the 
group containing these blocks. The plotted points 
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Figure 12. Frequency distribution of residuals obtained in an 
intercomparison test which produced anomalous results. 

Notice that tbe distributions do not indicate the effect which produced the 
anomaly. 
Top— Distribution obtained from second comparisons of pairs of gage blocks. 
Center— Distribution obtained from first comparisons of pairs of gage blocks. 
Bottom— Total distribution of residuals. 



190 



7.0 




1 


1 


1 




6.5 


- 






F323-F302 


- 


6.0 





o 


° 


o 


o 


5.5 
c 


- 


1 


1 


1 


- 


X 8.0 




1 


1 


1 


; 


t- 
o 

y 7.5 

2 


— 


o 


o 


F327-F302 
o 


o 


g 7.0 

LlI 

q: 

w 6.5 




1 


• 

1 


1 




Q 




1 


1 


1 




5.0 








F330-F302 


- 


4.5 


o 


o 


o 


o 





4.0 






/ 




- 


3.5 




1 


1 


1 


- 



10 
TIME, WEEKS 



Figure 13. Illustration of anomalous results obtained in one 
intercom parison test in which the F302 gage block received a 
different handling prior to the test. 



indicate the values obtained for these differences in 
each particular intercomparison test. The values 
obtained in the test here in question are marked on 
each graph by the small arrows. It can be seen that 
the values obtained in the intercomparison tests pre- 
ceding this one show a certain consistency. The 
test in question, however, in each case gave a value 
several ten-millionths of an inch lower than the pre- 
viously consistent values. Yet the only variation 
in testing procedure noticed was the different treat- 
ment afforded the F302 block prior to the intercom- 
parison test, occasioned by the procedure involved 
in its interferometric measurement. To determine 
whether this variation was indeed the significant 
factor, another intercomparison test was run on this 
same group of blocks four days later, with care being 
taken that the normal procedure was followed 
throughout the handling and the test. The values 
obtained in this and subsequent intercomparison 
tests are shown in figure 13 to the right of those 
marked with the small arrows. These values are 
again consistent with those obtained prior to the 
intercomparison test in which the variation occurred. 
Thus it appears that the anomalous results are indeed 
due to the variation in procedure which caused the 
F302 block to receive different treatment from that 
received by the other ten blocks in the group. Fur- 
ther, it should be noted that this variation went un- 
detected by the residual distributions employed as 
statistical controls (figure 12). This indicates that 
while these controls are of considerable value in 
maintaining uniformity of technique, the}^ are, 
nevertheless, ineffective with certain types of 
variation. 



6. Results of Stability Measurements 
6.1. Method of Presenting Data 

The data obtained from the observation of stabil- 
ity are presented in figures 14, 15, 16, and 17. In 
these figures, time elapsed since final heat treatment 
is plotted against change in length. Each plotted 
point has an upper and lower limit which is the esti- 
mated precision of the determination. This esti- 
mate was based upon the statistical information 
derived from the test itself. When the frequency 
distribution of all the measurement residuals of an 
intercomparison test indicated a near normal distri- 
bution and when the residuals were limited to a 
range within 3 times the calculated standard devia- 
tion of a single reading, the evaluated precision of the 
intercomparison test was estimated to be 3 times the 
computed standard deviation of the final result. 
When the range of the frequency distribution ex- 
ceeded that to be expected from the calculated 
standard deviation, a factor of 4 times the stain laid 
deviation was applied as an estimate of precision. 

Large backloads at the grinding shop and time 
spent accumulating sufficient blocks for an efficient 
lap load, in some cases, caused considerable delay in 
the interval between final heat treatment (stress 
relief) and final lapping. In addition, procedures for 
measuring the blocks were being developed simul- 
taneously and were not ready until after some of the 
blocks had been completed for some time. Plotting 
the time elapsed since final heat treatment compen- 
sated for the delays and put each block on a more 
comparable basis. 

6.2. Commercial Gage Blocks 

As a basis of comparison, a total of seven 2 in. 
steel gage blocks, two from each of three manufac- 
turers and one 8 from a fourth, were purchased on 
the open market and incorporated into the measuring 
program. The blocks were ordered as "AA" grade, 
the best quality available. The results obtained 
from observing the stability of these blocks are shown 
in figure 14. The abscissa for tins figure is the 
number of months elapsed since purchase. While 
it would have been more desirable to have plotted 
the months elapsed since final heat treatment, such 
data were not available. All of the commercial 
blocks have become shorter, although block A of 
manufacturer 2 and blocks A and B of manufacturer 
3 initially indicated a tendency towards growth. 
There is also a considerable degree of similarity be- 
tween the stability characteristics cf paired blocks 
from each manufacturer. The apparent overall 
stability of these blocks, extrapolated to a period of 
one year, ranges from a minimum of — 0.7X10 -6 in./ 
in. to a maximum of — 1 .9 X 10" 6 in. /in. The average 
change in length for the seven blocks is — 1.1X10" 6 
in./in./yr, which is adequate to maintain size within 
the current Federal specification for only 2 yr. It is 



8 Two blocks were purchased, but one was unsuitable for measurement. 
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Figure 14. The stability of commercial gage blocks of "A A" 
grade obtained directly from four manufacture's. 

a standard procedure of some manufacturers to finish 
their blocks on the positive side of the tolerance to 
allow for what is claimed to be wear. This procedure 
could extend the time within tolerance for the aver- 
age of these blocks to 4 yr, assuming a uniform contin- 
uance of the contraction. 

6.3. 52100, Hardened 

The results of stability measurements on hardened 
52100 steel gage blocks are shown in figure 15, and 
include blocks hardened either by martempering or 
by direct quenching. The six curves plotted in 
section A represent stability characteristics of blocks 
given the lowest final temper and stress relief so as 
to obtain a hardness of 65 R c . Each block that was 
measured during the first 5 months became shorter, 
and became nearly stable for the remaining period of 
observation; block T-337 showed a slight tendency 
to decrease in length with increase in time over the 
entire period of its observation. The initial con- 
traction was more pronounced in those blocks 
measured soon after final stress relief, and very small 
or absent in blocks whose initial measurements were 
made 5 months after heat treatment. All six curves 
have similar characteristics, regardless of whether 
the blocks they represent were martempered or 
quenched. The overall change in length computed 
on the basis of one year ranges from — 0.2X10 -6 to 
— 0.7X10" 6 in. /in. The average change for the 
six blocks is — 0.4X10 -6 in. /in., a value indicating 
approximately three times more stability than the 
commercial blocks. A more realistic approach is to 
compute the length changes after the sixth month, 
since the blocks appear essentially stable once the 
initial rate of contraction has subsided. On this 



basis the minimum change, extrapolated to 1 yr r 
is 0.0 and the maximum — 0.3X10 -6 in./in./yr. The 
average is a very low — 0.1X10 -6 in./in./yr, indicat- 
ing about 10 times greater stability than the com- 
mercial average, and well within the goals of ±0.2 
X10~ 6 in./in./yr set for this investigation. 

The four curves in section B and the four in 
section C of figure 15 represent the stability of blocks 
that were given final tempers and stress relief treat- 
ments at temperatures in excess of 250° F to reduce 
nominal hardness to 62 R c , and 60 R c respectively. 
These stability results were not anticipated, for it was 
initially reasoned that the higher tempering and 
stress relief temperatures would produce a more 
stable structure and stress pattern. Instead, the 
eight blocks represented by the curves in B and C 
appear less stable than those in A. The directly 
quenched blocks in B and C (T-377, T-378, T-384, 
T-386) have not been observed sufficiently long to 
ascertain the exact shape of their stability curves. 
Although the curves for the four blocks have been 
drawn linearly, they all exhibit what could be a 
tendency to flatten during the last four measure- 
ments. Nevertheless, the shapes of the curves are 
undoubtedly different from the curves of the match- 
ing martempered blocks in sections B and C (T-351, 
T-356, T-357, T-359). The four directly quenched 
blocks were the only blocks whose nongaging surfaces 
were ground perpendicular to the 2 in. dimension; 
all others were ground parallel. 
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Figure 15. The stability of hardened and stabilized 52100 
experirnental gage blocks. 

Solid lines represent martempered blocks, dashed lines represent directly 
quenched blocks. 
A, 65 R c ; B, 62 R c ; C, 60 R c . 
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The large surfaces adjacent to the gaging surfaces 
of two hardened 52100 gage blocks were analyzed for 
residual stresses by W. E. Littman and A. L. Chris t- 
enson, The Timken Roller Bearing Co., in accordance 
with the X-ray techniques of Christenson and Row- 
land [19]. One of these blocks had been heat treated 
for maximum hardness (65 R c ) and ground in a man- 
ner identical to blocks T-343, T-344, and T-348 
(section A, fig. 15). The other was prepared with a 
hardness of 60 R c in a manner identical to that used 
for blocks T-384 and T-386. The block tempered 
at 250° F to a hardness of 65 R ( . had a residual com- 
pressive surface stress of 14,400 psi parallel to the 
grinding direction and 60,200 psi perpendicular to 
the grinding direction. The block tempered at 465° 
F (60 R c ) had residual compressive stresses of 20,100 
psi parallel and 70,500 psi perpendicular to the grind- 
ing direction. Thus, the data indicate that the 
compressive stresses in the surfaces of the blocks 
actuallv increase with an increase in the tempering 
temperature from 250° to 465° F. Therefore, it is 
postulated thai the process of tempering at tempera- 
tures in excess of 250° F caused a structural change 
within the block which was accompanied by a con- 
traction. The surface stresses, however, were not 
relieved at a rate sufficiently high to counterbalance 
the internal contractions, with the overall result that 
the compressive stresses in the surface were increased 
by the increase in tempering temperature. The net 
result seems to have been an unbalance between the 
subsequent structural and lattice changes and the 
distribution and size of residual stresses, which in 
turn has contributed to a growth of four blocks 
(T-351, T-356, T-357, T-359) in sections B and C, 
figure 15. On the other hand, grinding the other 
four blocks at a 90 degrees direction has shifted the 
maximum observed compressive stress by 90 degrees. 
It is suggested that the observed shrinkage in these 
blocks is caused by the change in the orientation of 
the stress patterns. These comments concerning the 
influence of grinding stresses are considered tentative 
and several experiments have been designed and are 
in progress which are expected to lead to a clarification 
of the problem. 

6.4. 410 Stainless, Annealed and Nitrided 

The results of stability measurements on annealed 
and nitrided 410 stainless gage blocks are shown in 
figure 16. The four curves plotted in section A rep- 
resent the stability characteristics of blocks nitrided 
by the two stage process and whose nongaging sur- 
faces were not ground or otherwise machined after 
nitriding. The entire group (A) exhibits similar 
stability characteristics; the slope of each curve is 
almost the same. There was practically no devia- 
tion from linearity during the entire 13 month period 
of observation, although a tendency towards addi- 
tional flattening may he indicated in the last four 
measurements. It is unfortunate that no measure- 
ments could be made prior to the twelfth month after 
heat treatment, so that the behavior of these blocks 
during the first year could have been observed, The 
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TIME ELAPSED SINCE FINAL HEAT TREATMENT , MONTHS 

Figure 1(>. The stability of nitrided, initially annealed J t 10 
stainless steel gage blocks. 

A. Nitrided by two stage process, nongaging surfaces left as nitrided. 

B. Nitrided by single stage process, white layer remove, I from nongaging 
surfaces. 

C. Nitrided by single stage process, nitride! case completely removed from 
nongaging surfaces. 

overall change in length computed on the basis of 1 
year is a consistent +0.2X10 -6 in./in./yr. This 
value just meets the degree of tolerance sought in 
this investigation. Based on a 1 year interval, 
any one of these blocks is about 3 times more stable 
than the best of the commercial blocks tested, 5 
times more stable than the average, and 9 times more 
stable than the least stable. 

The curves in section B of figure 16 represent data 
from three blocks which were nitrided by tin 4 con- 
ventional single stage process. The preparation of 
these blocks also differs from that in section A in that 
the white layer on the nongaging surfaces was 
ground off, so as to leave a hard, bright , nitrided case. 
The stability of these blocks is almost the same as for 
those in section A. The range is +0.1 X10" 6 to 
+ 0.3X10" 6 in./in./yr with an average of +0.2X10" 6 . 
The curve for F-333 has an extremely low slope, but 
this block has been observed for only 9 months and 
the trend of the last four points is towards greater 
slope. The average of this group is equivalent to 
that of group A, but there is slightly more scatter. 

The blocks represented by the curves in section C 
of figure 16 were nitrided by the single stage process 
and differ from those in B in that all of the nitrided 
cases w r ere removed from the four nongaging faces 
by grinding. These blocks exhibit the same trend 
tow ards uniform linear growth, but the rate is higher. 
The range is +0.4X10" 6 to +0.9X10" 6 in./in./yr 
with an average of +0.6X10 -6 . Except for block 
F-305 each curve has a similar slope, and again the 
nonconforming curve was drawn through few x er 
points of observations. The last two or three points 
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plotted for each curve, except F-305, indicate a 
downtrend. The average of this group is more stable 
than the most stable commercial block observed, and 
has twice the degree of stability as the average of the 
commercial group. 

If the assumption is made that the 410 stainless, as 
annealed, has a normal tendency to grow, and the 
data support this assumption, then the improved 
performance of the blocks with nitrided nongaging 
faces could be explained. The nitrided surfaces 
could serve as a restraining jacket, which would be 
more effective with increasing thickness. Thus, 
the blocks whose nongaging faces were not ground at 
all (A, fig. 16) had the thickest case and grew the 
least, those whose white layer was removed (B, fig. 
16) had a thinner case and indicated slightly less 
uniform stability characteristics, and those whose 
case was removed entirely (C, fig. 16) had maximum 
growth. The investigation is being extended to 
further evaluate the effect of the thickness of nitrided 
cases on nongaging faces. 

Residual stress determinations were made by 
Littman and Christenson on the nongaging surfaces 
of nitrided 410 stainless steel blocks. A block proc- 
essed similarly to those in section A of figure 16 
had residual tensile stresses of 3,000 psi parallel to 
the 2 in. gaging length and 2,800 psi perpendicular to 
the gaging length (these blocks not ground after 
nitriding). A block processed like those in section 
B had a residual tensile stress of 31,100 psi in the 
direction parallel to grinding (stresses perpendicular 
to grinding not determined), while a block representa- 
tive of those in C had compressive stresses of 1,300 
psi parallel to grinding and only 900 psi perpendicular 
to grinding. Except for the fact that the relief of 
residual compressive stresses would be expected to 
cause growth, no apparent relationship can be seen 
between the reported residual stresses and the rate of 
growth of the different blocks. In actuality, the 
values of residual stress reported for blocks in A and 
in C are very low and should not have contributed 
materially to length changes. 

As with the hardened 52100 blocks, several ad- 
ditional experimental treatments have been designed 
which should contribute additionally to the under- 
standing of the role of surface stresses. 



6.5. Blocks With Hard Coatings 

The results of stability measurements on both 
annealed 52100 and annealed 410 gage blocks with 
hard coatings are given in figure 17. The stability 
characteristics of 52100 steel coated only on the 
gaging surfaces with thermal sprayed nickel-chro- 
mium-boron alloy is represented in section A. The 
steel was heated after coating to fuse the particles 
and some degree of hardening occurred as a result. 
The hardness of the steel after the fusion treatment 
was 43 R c . Both blocks have similar characteristics, 
both grew slowly at a linear rate. T-309 grew 
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TIME ELAPSED SINCE FINAL HEAT TREATMENT, MONTHS 

Figure 17. The stability of initially annealed 52100 (T 
blocks) and 1^10 stainless steel gage blocks (F blocks) with 
hard coatings. 

A. Gaging surfaces coated with thermal sprayed nickel-chromium-boron alloy 

B. Gaging surfaces coated with flame plated tungsten carbide. 

C. Surfaces electroplated with chromium, T blocks on all surfaces, F blocks on 
gaging surfaces only. 

0.5X10- 6 in./in., extrapolated to 1 3^r, and T-312 
grew 0.3 X10" 6 in./in./yr. 

The blocks represented in section B, figure 17, 
have been flame plated with tungsten carbide on 
gaging surfaces only. Both of the 52100 blocks 
(T-301 and T-302) have similar stability charac- 
teristics. Initially they expanded at a rate similar 
to 410 stainless block F-317 in section B, but they 
have exhibited more stable characteristics during the 
last 6 months of observation. The 410 blocks have 
grown rapidly, much more so than the nitrided blocks 
in section C of figure 16. This particular comparison 
is made because the blocks in figure 16C were ground 
on the nongaging faces and stress relieved at 975° F 
in the same manner as the blocks illustrated in section 
B of figure 17. Therefore, the core material in each 
group has essentially the same structure and residual 
surface stress pattern and the difference in behavior 
can be attributed to the cases. 

The blocks whose stability characteristics are 
shown in section C figure 17 were chromium electro- 
plated. T-314 and T-318 were plated on all six 
surfaces and the plating on the nongaging faces was 
ground sufficiently to obtain desired dimensions. 
Blocks F-352 and F-358 were plated on the ends 
only. The 52100 blocks are reacting similarly to 
one another and the two 410 stainless blocks also 
have curves similar to each other. The former are 
contracting although there was an initial increase in 
T-314. The chromium plated 410 stainless blocks 
are increasing in size at a fairly rapid rate. 
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6.6. Overall Observations 

a. On Stability of Gage Blocks 

The comparative changes in length for all of the 
blocks, arranged in order of increasing change, are 
summarized in table 6. A time increment of 1 yr 
has been used, which necessitated extrapolation in 
some cases. The most stable groups of blocks for 
the period observed were the nitrided 410 stainless 
with all or portions of the nitrided cases left on all 
surfaces. These blocks had stability characteristics 
that met the goal set for this investigation, namely, 
a maximum dimensional change of 2X10" 7 in./in./yr. 
These blocks proved to be resistant to normal 
atmospheric corrosion and accepted the best lapped 
finish of any block tested. The reproducibility of 
performance in these blocks, as evidenced by the 
uniformity of slope and low spread of individual 
values in each group, was also excellent. There was 
no apparent deviation from linearity in the dimen- 
sional changes of any of the nitrided 410 stainless 
blocks, but all, including the coated and plated 
blocks, showed some tendencies towards growth. 
Disadvantageously, the coefficients of thermal expan- 
sion and conductivity are somewhat lower than 
desirable. 



Table 6. The stability of gage blocks over a one year period, 
in order of merit 



Steel and treatment 



1. 410 stainless, nitrided, two stas:e, nongainng faces as nitrided 

2. 410 stainless, nitrided, single stage, white layer removed 

3. 52100, hardened and tempered to 65 R 

(after 0th month). 

4. 52100, thermal sprayed with Ni-Cr-B 

5. 52100, hardened and tempered to 00 He, ground parallel to 2 in. 

axis 

6. 52100, chromium plated on all faces 

7. 52100, hardened and tempered to 62 Re, ground parallel to 2 in. 

axis 

8. 410 stainless, nitrided, 1 stage, nongaging cases removed 

9. 52100, flame plated with tungsten carbide 

10. 52100, hardened and tempered to 60 R c , ground perpendicular to 

2 in. axis 

11. 52100, hardened and tempered to 62 R c , ground perpendicular to 

2 in. axis 

12. 410 stainless, chromium plated on ends 

13. Commercial "AA" grade 

14. 410 stainless, flame plated with tungsten carbide 



Avg change 
in length 



i in./in./yr 

+0.2 
+0.2 
-0.4 
(-0. 1) 

+0.4 

+0. 4 
-0.4 



+0.5 
+0.6 

+0.7 



-0.9 

+1.0 



-1.1 
+1.3 



The best of the blocks made from 52100 were those 
hardened and stabilized at the high hardness of 65 
R c . The repetition obtained within this group was 
excellent, and included both directly quenched and 
martempered blocks. If the first 6 months after 
final heat treatment are disregarded, these blocks 
exhibited even greater stability than the best of the 
410 stainless. All of the hardened 52100 blocks on 
which observations were made during the first 6 
months contracted initially and then stopped con- 
tracting, or expanded according to the tempering or 
grinding treatment given them. 



Several of the blocks with hard coatings were more 
stable than the commercial blocks tested. Both the 
sprayed Ni-Cr-B and the plated tungsten carbide 
apparently caused an overall growth, but on the 
52100 blocks the growth was small or had subsided. 
The principal undesirable feature noted with the 
Ni-Cr-B and tungsten carbide coatings was the high 
porosity of surface obtained on lapping, which was 
readily apparent to the unaided eye. 

b. On Precision of Length Measurements 

Three types of measurement were employed in de- 
termining the length of the stability samples: 

1. Absolute interferometric measurement in which 
the length of the primary master was determined 
with the wavelength of light. 

2. Interferometric comparison measurement in 
which the lengths of the secondary masters were com- 
pared with the length of the primary master using the 
wavelength of light as a length scale. 

3. Mechanical comparisons of the 10 stability sam- 
ples of a group with the secondary master belonging 
to that group. 

Of the various types of measurement, the absolute 
measurement was the most difficult and the least 
precise for reasons mentioned in section 5.1. Because 
absolute measurements of the primary master were 
initiated in 1954 and since many measurements have 
been made at irregular intervals from that time on, 
it was believed that its stability could be determined 
to a much greater precision than individual absolute 
measurements indicated. For instance, the largest 
deviation of a single measurement from the average 
of all 33 measurements made since 1954 was 1.2 /xin. 
The standard deviation of a single reading was 0.55 
/xin. However, in fitting a curve to these data, it 
became obvious that a cyclic function with a yearly 
period best fitted the measurements. Using January 
1, 1954 as a zero time reference, a curve calculated 
by the least squares method to fit the measurement 
data is expressed by the equation: 



L- 



-. A sin (j±+<ty+Ct+D 



where L= length deviation from nominal size (2 in.) 
,4= +0.75 /xm. 
B=12 mo 

£=time of measurement in months (January 
1, 1954 = 0) 

0=1.19 7T 

<?= +0.0035 /xin./mo 
Z>=+4.59 /xin. 

The standard deviation of all measurements from 
this curve was 0.28 /xin. with the largest deviation for 
a single measurement being 0.5 /jliii. It was assumed 
that the instability of this gage block is expressed by 
the function AL=CM whereas the sinusoidal varia- 
tion is an effect due to error in determination of the 
effective temperature of the gage block. All absolute 
measurements on this gage block were made using 
one interferometer occupying one location in a con- 
stant temperature room. The temperature of the 
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gage block was determined with one junction of a 
thermocouple held at the surface of the gage block 
with a spring clip. The other junction of the thermo- 
couple was imbedded in a copper block surrounded by 
an insulated aluminum-sheathed box. The tempera- 
ture of the copper block was determined with a plati- 
num resistance thermometer. The temperature of 
the copper block related to that of the air in the room 
showed a seasonal variation, and was generally colder 
than the air in the winter and warmer in the summer. 
If the effective temperature of the gage block relative 
to the temperature measured by the thermocouple 
junction at its surface is analogous to the relationship 
of the copper block temperature to that of the air, 
and if the difference in temperature approaches a 
maximum of 0.05° F, the cyclic effect can be ration- 
alized. 

Based on the assumption that the instability of the 
primary standard can be expressed as CM, the pri- 
mary standard, according to measurement, is growing 
at the rate of 0.04 /xin./yr. It is believed that this 
value is accurate to within 100 percent. An error of 
such small magnitude in the determination of the 
instability of the primary master block would have 
no significant effect on the stability results of the 
samples reported. 

Interferometric comparison of the primary master 
with the secondary master blocks (the stability sam- 
ples serving as references for the groups of stability 
samples compared mechanically) were made with the 
interference comparator mentioned in section 5.1. 
This interferometer has been subjected to much in- 
vestigation in regard to the precision of its measure- 
ments, [16] the uniformity of the wringing films, and 
the wear resulting from repeated wringings [20]. As 
a result of these investigations a precision of ± 0.2 /xin. 
has generally be3n applied to individual comparisons. 
Stability samples block A, manufacturer 1, figure 14; 
T-337, figure 15; F-302, figure 16; and F-352, 
figure 17 are examples of these secondary master 
blocks. 

From the metrological viewpoint, the results ob- 
tained with the mechanical comparator employing 
transducers in tandem were most interesting. Em- 
ploying the concept of comparison of dynamic 
lengths and using statistical analysis of the measure- 
ment data to evolve the measurement program, it 
was possible to obtain residual measurement errors 
having very small spread and nearly normal distri- 
bution. Employing intercomparison tests involving 
110 separate comparisons of the gage block samples 
of a group, it was found possible to limit the residual 
errors to a spread of ± 0.6 /xin. The standard devia- 
tion (a) of the result of such an intercomparison test 
was found to be approximately 0.08 /xin. As the 
residual errors formed a nearly Gaussian distribution, 
a 99.7 percent confidence limit of random error (3c) 
of ±0.24 /xin. was indicated for the results of such 
an intercomparison test. 

As the tests were repeated at periodic intervals, it 
was possible to test the reliability of the above 
statistical evaluation of precision. Most measure- 
ments of the stability samples reported extended 



over a period approximating 1 yr. Three different 
operators were employed and the temperature of the 
rooms in which tests were conducted varied from 
a few tenths of a degree to approximately 2° F. 
A small advantage in the control of residual error 
spread seemed to be achieved in using the best tem- 
perature-controlled room. One operator's residual 
error distributions, in general, had more scatter in 
the tails of the distributions than did the other two 
operators. No seasonal variations, as appeared in 
the absolute interferometric measurement of the 
primary master block, were noticed. It was found 
that when care was taken to expose the blocks of a 
group to the same conditions for at least 18 hr prior 
to an intercomparison test, the consistency of the 
periodic results were within the limits of the precision 
calculated from the statistical evaluation, i.e., ap- 
proximately 0.2 /xin. Figure 13 illustrates the con- 
sistency obtained in monthly measurements and also 
illustrates, by the exception, the effects of treating 
the gage blocks differently prior to the intercom- 
parison test. 

Another indication that precision of the above 
magnitude is being obtained in mechanical compari- 
son was derived from the results of mechanical com- 
parison tests conducted to determine the thermal 
coefficient of linear expansion of the gage block 
samples. In this procedure, intercomparison tests 
on a group of samples are conducted at two tem- 
peratures. From the results of the two tests the 
magnitude of the changes in the length relationships 
of the blocks of the group can be determined. 
Knowing the difference in temperature of the two 
tests, the coefficients of all the blocks relative to that 
of the secondary master block of the group can be 
determined. The coefficient of the secondary master 
is then measured by interferometric methods (change 
of length with temperature determined in terms of 
wavelength of light) and thus the coefficients of all 
blocks of the group can be calculated. As a cross 
check on the precision of the mechanical measure- 
ment and as a check on the consistency of the cali- 
bration of the mechanical comparator, the coefficients 
of some blocks determined by mechanical comparison 
techniques were compared with coefficients deter- 
mined by interferometric methods. In general, the 
agreement of results of such tests indicated that the 
length changes resulting from temperature variation 
as measured by the mechanical comparator were 
accurate to better than 0.2 /xin. 

A result obtained from the investigation of thermal 
coefficient of expansion is worthy of note. It is 
reported in the literature that 52100 steel has an 
approximately 2 percent smaller thermal coefficient 
of linear expansion in the annealed state than when 
hardened to 65 R c . It was found in this investiga- 
tion that this steel hardened to 60 R c had a thermal 
coefficient of expansion about 3 percent lower than 
that hardened to 65 R (table 2). This was verified 
by both mechanical comparison and interferometric 
methods of measurement. 

From the history of past interferometric measure- 
ments on the primary master; from the conclusions 
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of Dexter's work [20] on wear occurring using the 
interference comparator; and from the fact that 
interference measurements were made on a relatively 
infrequent basis, it was concluded that if wear did 
occur from interferometric measurements, it was 
negligible. However, no information was available 
on the wear effects to be expected in the mechanical 
comparisons. To allow an evaluation of this effect, 
the frequency of test was changed from weekly 
to monthly tests. It was reasoned that if wear did 
have an effect on the measured stability trends of the 
blocks, a change in the frequency of test would have 
an effect upon the trends of length changes exhibited 
by the blocks. Such effects did not occur. 

7. Summary and Conclusions 

1. A program has been described for the develop- 
ment of steel gage blocks with a maximum dimen- 
sional change of 2X10~ 7 in./in./yr, a degree 4 hereto- 
fore unobtainable with consistency. The problem 
had a dual nature in that procedures for the selection 
and processing of materials and suitable techniques 
for measurement to the desired precision were de- 
veloped simultaneously. 

2. The data presented are the result of observa- 
tions on two steels given a total of 14 treatments, but 
which represent only a small proportion of the blocks 
under development or observation. From this total, 
two treatments applied to 410 stainless steel produced 
gage blocks with an average and uniform dimensional 
change of 2X10 -7 in./in./yr. One treatment applied 
to the 52100 steel produced gage blocks with an 
extremely high degree of stability (1X10 -7 in./in./yr) 
after an initial less stable period of 6 months. Al- 
though the results indicate that the goal of the inves- 
tigation may have been met, periods of observation 
greater than 1 yr arc 4 needed to establish the 4 stability 
characteristics more firmly. Further improvements 
in the development of materials and measuring 
techniques seem possible and will be sought. The 
failure of other treatments of the 410 and 52100 
steels to produce equally stable gage blocks in those 
cases where the treatments were similar except for 
small modifications, such as direction of grinding or 
thickness of nitrided case, has suggested other courses 
of investigation which are being pursued. Other 
more subtle influences on stability are being studied 
also, such as influence of residual magnetism (in- 
duced by magnetic grinding chuck) and environ- 
mental temperature changes. 

3. The method of reporting length in inch per inch 
is a matter of convention and convenience and should 
not be construed as being directly convertible to any 
size of gage block, particularly those of less than 1 
in. Size effects can influence both the metallurgical 
and metrological factors and consideration is being 
given to the investigation of these effects. 

4. Mechanical comparators can be used for 
measurements with a precision approaching 2X10~ 7 
in. The procedures involved are also applicable to 
the rapid measurement of a large number of parts 
of the same nominal size and thermal properties, and 



therefore can be adapted to industrial applications. 
Statistical analysis, used in conjunction with the 
comparator techniques, has application in determin- 
ing the most suitable procedures and providing 
continued uniformity in the application of the 
technique. 
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8. Appendix A: Establishment of Optimum 
Heat Treating Conditions for 52100 Steel 

Specimens of the steel were heat treated hy direct 
quenching or by martempering followed by various 
stabilizing treatments. All specimens used for these 
heat-treating experiments were }{ in. cubes. The 
retained austenite content was determined by X-ray 
diffraction on cross sections of the specimens. The 
method used employed cobalt Ka radiation with iron 
filtration, a geiger tube detector, and a step-scanning 
technique. Originally, both the (220) and (311) 
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ines of austenite and the (211) line of martensite 
were used in the computations, but the use of only 
the (220) line of austenite and the (211) line of mar- 
tensite produced comparable results and thus elim- 
inated a great deal of laborious step scanning, and 
in later determinations only these were used. Guided 
by the results of the X-ray analysis, the treatments 
were continuously revised until the austenite could 
no longer be detected. A summary of the treat- 
ments and the retained austenite measured as the 
result of each is shown in table 7. 



Several pertinent observations can be made from 
these data. The maximum amount of retained 
austenite measured was about 15 percent and no 
values were obtained between 8 and 11 percent; the 
minimum amount obtained ranged from none de- 
tected to about 3 percent. There were no values 
between 3 and 4 percent and the intermediate quan- 
tities varied from greater than 4 percent to about 8 
percent. These separations facilitate a convenient 
grouping into specimens with high austenite, 15 to 
11 percent; intermediate austenite, 8 to 4 percent; 
and low austenite, 3 percent to none detected. 



Table 7. The effect of heat treatment and stabilization on the quantity of retained austenite in small 

specimens of 52100 steel 





Method of 
hardening 


Chronological 
order of proce- 
dures after 
hardening 


Stabilizing treatment 


Retained aus- 
tenite after 
stabilization 




Speci- 
men 
No. 


Refrigeration 
time 


Temper 


Remarks 




Temper- 
ature 


Time 


Volume 




T-216 


Martemper 

Direct quench . . 

Martemper 

Direct quench _ _ 

Martemper 

Martemper 

Martemper 

Martemper 

Martemper 

Martemper 

Direct quench __ 

Martemper 

Martemper 

Martemper 

Martemper 

Direct quench _ _ 
Martemper 


1st 


hr 


o F 

250 


hr 
1 


% 


Tempered prior to refrigeration. 




2d 

3d 


Overnight 


15.3 
13.2 
12.6 




250 


1 






4th 


Overnight 






5th 


250 
250 
230 

250 


8 

m 

i 
i 




T-219 _ 


Single step.. 




Tempered, no refrigeration. 


T-208 _ _ 


Single step 




Tempered, no refrigeration. 


T-220 


1st . 




Tempered prior to refrigeration. 




2d 

3d 


Overnight 


11.5 

7.7 

7.5 
6.7 

6.5 

6.1 
5.9 




250 


i 






4th 

5th 


Overnight 






250 


8 




T-215 


1st 


Overnight 






2d 


275 


2 






3d 

4th 


Overnight 






275 


2 




T-213 


1st 

2d 


2 






230 


IX 






3d 

4th 


2 






230 


1H 




T-209 


1st 

2d 


2 






230 


\y* 




T-214- 


1st 


3 






2d 


275 


2 






3d 


Overnight 






4th _ 


275 


2 




T-211 


1st 


2 






2d 


275 


1MI 




T-212 


1st 


2 






2d 


325 


l 




T-222 


1st 


IK 


Steps 1 & 2 repeated 10 addi- 




2d 


275 


l 


4.9 
4.4 

2.8 


tional times. 


T-210 


1st . 


6 






2d 


230 


l 




T-218 _ 


1st 

2d 


Overnight 






275 


l 






3d 


Overnight 






4th 


250 


9 




T-223 


1st 


Overnight 


Chilled in iced brine prior to 1st 




2d 


250 


1 


2.6 
1.4 
None detected 


refrigeration. 




3d 


Overnight 






4th 


250 


9 




T-217 


1st.. 


Overnight 






2d 


250 


1 






3d 


Overnight 






4th 


250 


9 




T-221 


1st 


Overnight 






2d 


250 


1 






3d 


Overnight 






4th _ 


250 


9 




T-226 


1st 


Overnight 


Refrigeration temperature was 




2d 


250 


2Vs 


None detected 


-110° F. 




3d 


Overnight 






4th 


250 


9 













NOTES TO TABLE: 

1 . All specimens were X A hi. cubes austenitized at 1550° F for 15 min in a neutral salt. Martempered specimens were quenched 
to 300° F for 30 sec in a mixture of NaN0 3 and NaN0 2 . 

2. Both the directly quenched and martempered specimens were quenched to room temperature in an accelerated quench- 
ing oil. 

3. Unless otherwise stated, all refrigeration treatments were at —140° F. An overnight refrigeration treatment may vary 
from 18 to 22 hr. 
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The four specimens in the high austenite group 
consist of two which were directly quenched and 
two which were martempered. The treatments 
given them had one feature in common; they were 
tempered immediately after hardening. No other 
specimen received this treatment and there is no 
doubt that it was responsible for stabilizing the 
retained austenite against substantial further trans- 
formation. 

The specimens in the intermediate group received 
a variety of stabilization treatments; however, all 
were refrigerated at —140° F as a first step after 
hardening. The length of time of refrigeration was 
varied from overnight (18 to 22 hr) to \% hr. The 
number of tempers and the temperatures used 
varied as did the number of refrigeration treatments. 
However, it is significant to note that most received 
individual refrigeration treatments of short duration 
(exception T-215) and tempers totaling 4 hr or less 
(exception T-222). None, including the two ex- 
cepted specimens, received long time refrigeration 
treatments, combined with tempering treatments 
of more than 9 hr at the temperatures shown. 

The specimens in the low austenite category, 
3 percent or less, have several common treatments. 
All were refrigerated for 18 to 22 hr immediately 
after hardening, all were tempered initially at 250 
to 275° F, all were refrigerated a second time for 18 
to 22 hr, and all were given a final temper of 250° F 
for 9 hr. The slight variations in treatment given 
to each are shown in table 7 and seem relatively 
unimportant. The important features are a refrig- 
eration of -110 to —140° F for 18 to 22 hr im- 
mediately after hardening, a short temper of 1 to 
2 hr at 250° F, a second refrigeration for 18 to22hr, 
and a final temper of 9 hr. The total prescribed 
tempering time of 10 hr was selected to conform 
with the conclusions advanced by Lement, Averbach, 
and Cohen [9] for ball bearing steel. 

On the basis of these data, the treatment given 
specimen T-221 was adopted for use with directly 
quenched gage blocks and that given T-217 for 
martempered blocks. The stabilizing treatment 
used with T-217 was adopted over that used with 
T-226 because of its similarity to that of T-221 and 
the convenience inherent in such an arrangement. 

Another series of heat and stabilization treatments 
was devised for 2 in. X 1% in. X % in. gage blocks to 
test the validity of the adopted treatments on full 
sized gage blocks, and to evaluate other variables. 
The treatments and the result of measurements of 
retained austenite are summarized in table 8. The 
readiness with which some austenite becomes stabi- 
lized with delay in treatment is shown in a number 
of cases. For example, block T-323 was treated 
similarly to small specimen T-217 and in almost the 
same manner as block T-333, except for a 48 hr. 
lapse between the final refrigeration and final temper 
of T-323. T-323 had a considerably greater amount 
of retained austenite. Shorter delays also appear 
injurious, as for example, in the comparison of speci- 
mens T-223 and T-217 (table 7). T-223 was held 
in iced brine for 2 min immediately after quenching 



to room temperature in oil, and then it was placed 
in liquid CH 3 OH (methyl alcohol) at -140° F. On 
the other hand, T-217 went into the CH 3 OH directly 
without the opportunity to age at a higher temper- 
ature and it contains less austenite. The same trend 
is indicated between blocks T-328 arid T-331 (table 
8). Blocks T-329 and T-332 contained somewhat 
more austenite than small specimen T-221 which was 
treated in the same way, and this may have been 
caused by the difference in cooling rate between 
the larger blocks and smaller specimen. 

The greater austenite content may also have been 
caused by the differences in stress distribution in 
the differently sized and shaped specimens. To 
avoid difficulties from delays, a cold mixture 
(CH3OH+ liquid N 2 at equilibrium, -144° F) was 
brought to the quenching tank and the blocks placed 
therein immediately after quenching. The cold 
container with the blocks was then transferred to 
the refrigeration unit where the temperature was 
maintained at —140° F for the required time. This 
is the two step refrigeration treatment listed in 
table 8. 

It was pointed out in the discussion of table 7 that 
no specimen with intermediate austenite had received 
a combination of long time refrigeration treatments 
and tempering treatments exceeding 9 hr. To 
further check the necessity of long refrigerating time, 
while tempering time was held at 10 hr, block T-335 
was given comparatively short time refrigeration 
treatments at —140° F and T-336 was given short 
time treatments at —110° F. Both had negligible 
amounts of retained austenite. 

It was concluded from these tests on the 52100 
treated for minimum retained austenite and a hard- 
ness of about 65 R c that : 

1. Refrigeration is a necessary first step imme- 
diately after hardening. 

2. Stabilizing treatments should be accomplished 
with the least possible delay between steps. 

3. Refrigeration temperatures in the range —110° 
to —140° F are equally satisfactory, and two treat- 
ments in this range are ample. 

4. The time of holding at refrigeration tempera- 
ture can be as short as 2 hr for the initial treatment 
and 3 hr for the second treatment. 

5. A first temper of 1 hr at 250° F appears ade- 
quate, an extension of this temper beyond 2 hr, or 
above 250° F, may induce some stabilization of 
austenite. 

6. A final temper of 9 hr at 250° F or slightly 
higher is adequate. 

9. Appendix B: Hard Coatings, Description, 
and Application 

9.1. Thermal Spray 

The thermal spraying process consists of melting 
or softening a wire or powder in a suitable gun and 
directing the spray of liquid or softened particles 
onto the surface to be coated. The allov used was a 
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Table 8. The effect of heat treatment and stabilization on the amount of retained austenite in gage blocks of 52100 steel 





Method of 
hardening 


Chronological 
order of pro- 
cedures after 
hardening 


Stabilizing treatment 


Retained aus- 
tenite after 
stabilization 




Gage 

block 

no. 


Refrigera- 
tion time 


Temper 


Remarks 




Temper- 
ature 


Time 


Volume 




T-323— 


Martemper 

Martemper 

Martemper 

Martemper 

Martemper 

Martemper 

Martemper 

Direct quench . 
Direct quench _. 


1st 

2d 


hr 

Overnight 


o F 


hr 


% 
5.3 

1.8 

1.4 
None detected 

3.8 
None detected 

1.0 

2.4 

2.5 


48 hr lapse between steps 3 and 4. 




250 


1 






3d 

4th 


Overnight 






250 


9 




T-328... 


1st 

2d . 


Overnight 


Quenched in water instead of oil. 




250 


1 


Given a brief iced brine quench 




3d 

4th 


Overnight 


between steps 2 and 3. 




250 


9 




T-331-. 


1st 


Overnight 


Quenched in water instead of oil. 
Two step refrigeration (see 




2d 


250 


1 




3d 

4th 


Overnight 


text). 




250 


9 




T-333— 


1st 


Overnight 


Quenched in oil, two step refrig- 




2d.__ 


250 


1 


eration. 




3d 

4th 


Overnight 






250 


9 




T-334... 


1st 


Overnight 


Refrigeration temperature was 




2d 


250 


21/3 


—110° F. Long first temper. 




3d 

4th 


Overnight 






250 


9 




T-335... 


1st 


2 


Refrigeration time reduced. 




2d 


250 


1 






3d 

4th 


4 






250 


p 




T-336... 


1st 

2d 


2 


Refrigeration time reduced. 




250 


1 


Temperature increased to 




3d 

4th 


3 


-110° F. 




250 


9 




T-329... 


1st 


Overnight 


Brief iced brine quench between 




2d._. 


250 


1 


steps 2 and 3. 




3d _. 


Overnight 




4th___ 


250 


9 




T-332... 


1st 


Overnight 


Two step refrigeration (see text) . 




2d 


250 


1 






3d 

4th 


Overnight 






250 


9 













NOTES TO TABLE: 

1. All gage blocks were nominally 2 in. X 1% in. X Ys in. in size, austenitized at 1550° F for 15 niin in a neutral salt. Martempered specimens were quenched 
to 390° F for 30 sec in a mixture of XaX0 3 and NaN0 2 . 

2. Both the directly quenched, and martempered blocks were quenched to room temperature in an accelerated quenching oil except where water is noted 
in the remarks column. 

3. Unless otherwise stated, all refrigeration treatments were at —140° F. An overnight refrigeration treatment may vary from 18 to 22 hr. 



self-fluxing alloy of nickel, chromium, and boron sold 
commercially as Thermospray 9 powder 16C. It 
was applied by a commercial firm to a thickness of 
about 0.015 in. on each gaging face. After lapping, 
the final thickness was 0.006 in. The coating re- 
quired a fusing treatment after application and this 
was done by the firm, but the exact temperature to 
which the blocks were heated could not be ascer- 
tained. The hardness of the coating was measured 
as 62 R c (converted from Vickers, 10 kg). After 
grinding and lapping, the surface of the coating 
appeared more porous than a wrought metal. A 
photomicrograph of the coating is shown in figure 
18 A. 

9.2. Flame Plate 

The flame plating process is somewhat similar to 
the thermal spray process, but its use is generally 
limited to the application of refractory alloys or 



3 Trademark of the Metallizing Equipment Co., Inc. 



ceramics, and with these materials a fusing treatment 
is not used. The coating is applied at supersonic 
velocities and is propelled by a controlled detonation 
within the barrel of the gun. The manufacturer 
claims that the surface of the piece being coated 
rarely exceeds 400° F. All flame plating was done 
by the originator of the process. 10 Both the tungsten 
carbide and the aluminum oxide coatings were applied 
to each gaging surface to a thickness of about 0.004 
in. The thickness of the coating on each, after 
lapping, was on the order of 0.0025 in. After lap- 
ping, considerable porosity could be observed in each 
of these coatings with the unaided eye. The 
tungsten carbide coating contains about 8 percent 
of cobalt, whereas the A1 2 3 is 99-)-% A1 2 3 . Hard- 
ness of both coatings is far in excess of 65 R c . The 
coefficients of thermal expansion of both of these 
coatings are considerably lower than steel, and are 
given by the manufacturer as 2.89X10 -6 / F (70° to 



10 Linde Air Products Co. 
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Figure 18. Microstructures of hard coatings. 

All except the chromium have been ground and lapped to final thickness. The chromium is shown as plated and stress relieved. 

A. Thermal sprayed Ni-Cr-B on 52100 steel. Etched with 1% Nital. X500 

B. Flame plated tungsten carbide on 52100 steel. Etched with 1% Nital. X500 

C. Elame plated aluminum oxide on 52100 steel. Etched with 1% Nital. X500 

D. Chromium plate on D-2 tool steel. Etched with IIC1. X200. White area at lower left is a corner of the steel block. 



201 



150° F) for tungsten carbide and 4.0X10- 6 / F (100 
to 2,000° F) u for aluminum oxide. Photomicro- 
graphs of these two coatings are shown in figures 
18B and C. 

9.3. Chromium Plate 

Chromium was applied directly over the steels by 
conventional electroplating techniques. The bath 
consisted of 0.53 oz (avdp) of sulfuric acid and 53 
oz (avdp) of chromic acid per gallon of water. 
Current density was 180 to 190 amp/ft 2 and bath 
temperature was 120° F. The 52100 steel was plated 
on all surfaces and the 410 stainless was plated on 
the gaging surfaces only. The minimum thickness 
of the plating as applied was about 0.010 in. The 
finished thickness on the gaging faces and on the 
nongaging faces, when applied, was 0.005 in. Tests 
were run to ascertain the temperatures to which the 
plating could be subjected for the removal of hydro- 
gen and for stress relief. As plated, the hardness 
was 68 R c (converted from Knoop, 500 g) which did 
not fall below 65 R c until a temperature in excess of 
820° F was used. However, at this high temper- 
ature hairline cracks appeared in the plating, which 
were attributed to stresses caused by the differential 
thermal expansion of the block and the plating. A 
stress relieving temperature of 400° F for 5 hr was 
adopted to prevent cracking. A photomicrograph 
of the plated chromium after stress relieving at 
820° F is shown in figure 18D. In appearance, it 
does not differ from the as-deposited coating. 

10. Appendix C: Grinding Procedures and 
Other Details of Fabrication 

10.1. 52100, Hardened 

All of the 52100 blanks were ground to 2.04 in. 
X1.39 in. X 0.39 in. prior to hardening and stabiliza- 
tion. After completion of the heat treatment, all 



ii The lower value for the coefficient of thermal expansion reported in table 2 
was measured on solid AI2O3 blocks supplied by another manufacturer. 



but four of the blocks were ground to size on the 
four largest faces in a direction parallel to the 2 in. 
direction. The four excepted blocks (T-377, T-378, 
T-384, T-386) were ground on the four largest faces 
in a direction perpendicular to this dimension. The 
grinding wheel used and the operational settings of 
the surface grinder are given in table 9. 

After final grinding the blocks were stress relieved 
for 3 hr at the temperatures shown in table 4, and 
sent to a commercial firm for lapping. The surfaces 
of the lapped blocks were surveyed for parallelism 
and flatness, some blocks were used for thermal 
expansion or other measurements, and the best of 
each lot as to parallelism and flatness were incorpo- 
rated in the measuring program. 

10.2. 410 Stainless, Nitrided 

All 410 stainless blanks were ground to a length 
of 2.0050 in., but the width and thickness were 
varied so as to permit finishing to 1.375 in.X0.375 
in., since some of the surfaces received no grinding 
after nitriding and others received different amounts. 
Blanks intended for two stage nitriding, and on 
which the nongaging faces were to be left as nitrided, 
were ground to 1.374 in. X 0.374 in.; blanks on which 
only the frosty coating was to be removed were 
ground to 1.375 in.X0.375 in.; and blanks on which 
the cases on nongaging faces were to be completely 
removed were made about 1.430 in. X 0.430 in. 
(earlier blocks were slightly smaller). Details of the 
nitriding treatments given individual blocks are 
shown in table 4. After nitriding, all three series of 
410 blocks were ground to 2.0030 in. and two series 
were ground on the 4 nongaging surfaces to a width 
of 1.375 in. and a thickness of 0.375 in. Additional 
grinding details are given in table 9. 

All of the nitrided 410 blocks were stress relieved 
at 975° F for 3 hr after grinding and before sending 
to commercial firms for lapping. The final hardness 
of the cases and the dates of the final stress reliefs are 
included in table 4. The blocks were then lapped 
commercially and the most suitable of each lot placed 
in the measuring program. 



Table 



Details for grinding the hardened and coated gage blocks 



Type of surface 


Grindin 


g wheel 


Crossfeed 


Downfeed 


Table speed 




Rough 


Finish 


Rough 


Finish 


Rough 


Finish a 


Rough 


Finish 


Hardened 52100 


2A361G8V72K 

37C60J8V 


2A361G8V72K 

37C100J8V or 

37C100I7V 

37C100I7V 

37C100H8V or 

37 C 10018 V 
8A461J12V22 


in. 

0.050 
.010 

.020 
.025 

.030 


in. 
0.030 
.008 

.015 
.020 

.020 


in. 

0. 0015 
.0008 

.003 
.0005 

.001 


in. 

0. 0005 
.0003 

.0008 
.0003 

.0005 


ft/min 
65 
20 

50 
30 

85 


ft/min 

65 


Nitrided 410 stainless . .. _._ . . 


15 


Thermal spray, Ni-Cr-B. _. 


37C46J8V. 


30 


Flame plate, tungsten carbide 


37C46J8V... 


25 


Chromium plate _ _ __ _ _. 


8A461J12V22 or 
38A8018BE 


20 







a These values are for gaging surfaces and should be increased by about 50 per- 
cent on nongaging surfaces. 

Notes to Table: 

1. The nongaging faces of all blocks except four (T-377, T-378, T-384, T-386) 
were ground parallel to the 2 in. dimension. The four excepted blocks 
were ground perpendicular to the 2 in. direction. 

2. The grinding wheel speed was 2300 RPM. All wheels were 10 in. in diam 



when new and were discarded when worn to about 6 in. All wheels were 
% in. to 1 in. thick. 

3. All grinding was done wet with White-Bagely WB-1500 solution diluted 
with water to approximately 150 parts of water per 1 part solution. 

4. Downfeed was changed from rough to finish when 0.0005 in. of stock re- 
mained to be removed from each gaging surface and 0.002 in. to 0.005 
in. remained on each nongaging surface. 
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10.3. Blocks With Hord Coatings 

a. Thermal Spray 

The 52100 steel blanks were ground to 1.987 in. 
X 1.375 in. X 0.3 75 in., and the nickel-chromium- 
boron coating applied on the gaging faces only to a 
thickness of about 0.015 in. The blocks were then 
ground in the same directions as described for the 
hardened 52100 blocks. The four nongaging surfaces 
were ground just sufficiently to remove the black 
scale formed during the fusing treatment. The gag- 
ing surfaces were ground to reduce overall length to 
2.0030 in., leaving equal thickness of coating on each 
face. Further grinding details are given in table 9. 
After grinding, the blocks were stress relieved as 
shown in table 4, and sent to a commercial firm for 
lapping. 

b. Flame Plate 

The 52100 and the 410 stainless blanks were ground 
to 1.995 in. X 1.375 in.X0.375 in. prior to coating the 
gaging surfaces to a thickness of about 0.004 in. 
The nongaging surfaces were not coated. The sur- 
faces were ground to reduce overall length to 2.0030 
in., leaving equal thickness of coating on each face. 
Additional grinding details are given in table 9. The 
nongaging faces were not ground after plating. The 
blocks were stress relieved as shown in table 4 prior 
to lapping. 



c. Chromium Plate 

It is a characteristic trait of the chromium plating 
process that thicker deposits of metal build up at 
sharp outside corners. Such a build up is shown in 
the photomicrograph in figure 18D. This condition 
makes necessary the careful alinement of the block 
in the grinding chuck to prevent the plating from 
being ground nonparallel to the underlying surface 
with a resultant nonuniform thickness of plating. 
This in turn can cause opposite gaging faces which 
are parallel at one temperature to become nonparallel 
at another temperature, particularly if the nongaging 
faces of the gage block are plated and ground non- 
uniformly. The need for extremely close control to 
avoid this condition can be eliminated by plating the 
gaging surfaces only. The 52100 blanks were ground 
to 1.990 in. X 1.365 in.X0.365 in. prior to plating on 
all surfaces and the 410 stainless blanks were ground 
to 1.990 in. X 1.380 in.X0.380 in. for plating on the 
gaging faces only. The blanks were stress relieved 
at 975° F for 3 hr in a cracked ammonia atmosphere 
prior to plating. After plating, each block was ground 
to 2.0030 in. X 1.375 in. X 0.375 in. in accordance with 
the details given in table 9. After grinding the 
blocks were stress relieved at 400° F for 5 hr in a 
cracked ammonia atmosphere and sent to a lapping 
firm for the final step in processing. 



11. Appendix D: Nullification of Effects of 
Inhomogeneous, Nonlinear Measurement 
Error 

One method that may be used in refining the 
intercomparison testing technique is to arrange the 
sequence of comparisons to annul the effects of 
measurement error. This can be illustrated by the 
following example. Consider the four test speci- 
mens, gage blocks A, B, C, D in table 10 to have 
lengths a, b, c, and d respectively. Consider the 
systematic error in the comparator reading to be 
a function of time with slope a t , as shown in figure 
19, 12 and for the present ignore random errors. If 
the time interval of one comparison of a pair of gage 
blocks is At, the systematic error in a comparison 
occurring at time t is a t AL However, the curve 
shown in figure 19 may be approximated by (n— 1) 




Figure 19. A hypothetical nonlinear error function and its 
approximation by a number of linear segments. 



linear segments having slopes a u a 2 , « 3 , . . . a (n _D 
where n is the number of gage blocks in the group 
being intercompared, four in this example. The 
subscripts refer to periods of time in which n com- 
parisons are made. If the interval of each comparison 
is again At, the errors occurring during the compari- 
sons can be approximated by a x At, a 2 At, a z At, . . . 
a( n -i)At. By arranging the sequence of comparisons 
these systematic errors may be distributed so that 
they are approximately nullified in the results 
obtained by means of the type of calculation illus- 
trated in table 5. That is, if the sequence of com- 
parisons is so arranged that each column contains 
equal increments of the systematic errors, then 
the column footings will contain equal amounts of 

12 This function need be continuous only during the time of each individual 
comparison. 
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such error and in that event computation by means 
of the method illustrated by table 5 will provide 
results in which these errors are nullified. Table 10 
illustrates comparison data obtained when such a 
sequence of comparisons is utilized. 13 The circled 
numbers in table 10 indicate the sequence in which 
the comparisons were made. The residuals obtained 
with this sequence of comparison and utilizing the 
type of computation illustrated in table 5, would 
be grouped equally at a Y M, a 2 At, and a 3 At. It will be 
noticed that with this sequence (table 10) these 
systemmatic errors may also be eliminated from the 
residuals as well as from the results by applying the 
least squares type of solution. This is because the 
comparisons symmetrical to the diagonal (table 10) 
are made in the same time period (while a remains 
constant), in fact one immediately following the 
other. 

This latter requirement may introduce the neces- 
sity of further modification. With two comparisons 
of the same gage blocks being performed in a short 
time interval, thermal effects of handling in the first 
comparison may modify the error function in the 
second comparison so that two error functions exist ; 
i.e., inhomogeneous comparison data are obtained. 
It was reasoned that if the second comparison always 
followed the first by a constant time interval, and if 
the handling of the gage blocks during the two 
comparisons was always consistent, then the two 
error functions would differ by a fixed amount. If 
«n, cx-2i, a 3 i, . . . «(„_!)! refer to the slopes of the 
first error function in the time periods 1, 2, 3, . . . 
(n-l) respectively, and a l2 , a 22 , a Z2 , . . . a (? _i )2 refer 
to slopes of the second error function during these 
same time periods, then: 

(a n — a 12 )At=(a 2 i — a 22 )At=(a M — a 32 )At 

= . . .(a lB -i,i-a ( »-i)2)^=iA< (1) 

To eliminate this type of error from the final 
results of an intercomparison test there should exist, 
as was said above, an equal magnitude of error effect 
in each column of the calculation chart. For a group 
of n specimens there will be n(n-l) comparisons in 
the intercomparison test; n(n-l)/2 comparisons of 

13 If a is constant, that is if ai=a 2 =m= . . . a(n-n then the systematic errors 
are nullified regardless of the sequence in which the comparisons are made since 
the equal increments of error always appear in each column. 



the first type, and an equal number of comparisons 
of the second type. If there is to be an equal num- 
ber of comparisons of each type in a column, (n-l)/2 
comparisons of a type should appear in a column. 
As this number must be an integer, n must be odd. 

Table 11 indicates an intercomparison test sched- 
ule that would approximately nullify two nonlinear 
error functions in the final results, an additional gage 
block has been added to the group to fulfill the 
requirement that n be odd. Spaces containing two 
approximately equal values represent comparisons 
made at times when the error function could be 
indicated by either of two slopes; e.g., at time ti in 
figure 19. 

Using eq (1) relating the error functions, the values 
indicated in table 12 are obtained from those shown 
in table 11. It will be noted that in the summations 
of each column of table 12 the amounts of system- 
atic error are equal. This also holds true if a 
least squares type of solution is applied to the data 
in table 12. This is shown in table 13 where this 
method of computation is employed. Here the sys- 
tematic error is cancelled within each column so 
that the column footings equally contain no system- 
atic error. Thus employing either method of com- 
putation with this sequence of comparisons, 
appropriate comparison of the column footings pro- 
vides the true relationships of the gage blocks even 
though inhomogeneous, nonlinear error functions are 
present in the observed measurements. The preci- 
sion of the results obtained by the least squares 
method is, of course, greater than that obtained 
with the method of computation illustrated in table 
5. Further, an examination of the residuals obtained 
with the two different methods of computation will 
indicate another reason for utilizing the least squares 
method. The residuals obtained from table 12 using 
the method of calculation illustrated in table 5 are 
given in table 14. It can be seen that residuals of 
various magnitude are obtained, the magnitude 
depending on the value of the two error functions 
(assuming At is constant). On the other hand, when 
the least squares method of computation is employed 
(table 13) the residuals shown in table 15 are ob- 
tained. It is obvious here that the magnitude of 
the residuals is dependent only upon the difference 
between the two error functions (again assuming At 



Table 10. Sequence of co?nparisons arranged to nullify effects of a nonlinear error function in an intercomparison test 



Blocks 


A 


B 


C 


D 


A 


* 


® b-a+onAt 


® c — a-\-azAt 


d—a-\-a 2 At 


B 


© a-b+*iAt 


* 


® c—b+a 2 At 


© d-b+azAt 


C 


® a— c+azM 


® b—C+a 2 At 


* 


® d—C+a\At 


D 


® a— d+a 2 At 


© b-d+a 3 At 


® C-d+«iA£ 


* 


2 


3 

3a-6-c-d+y^« n A« 

71=1 


3 

36— a— c— rf+^ )a n At 
n=l 


3 

3c-a-b-d-\-^>2ct n At 
71= 1 


3 
8d-a-b-c+y^,anAt 

71 = 1 


2/4 


3 
l/i(Sa-b-c-d-\-^2a n At) 
71 = 1 


3 

l/4(36-a-c-d+Xj"" A ^ 
n=l 


3 
l/4(3c-a-6-tH-^)tt w AQ 
n = l 


3 

l/4(3d-c-6-c+23«„A/) 

71 = 1 
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Table 11. Inter comparison test schedule nullifying the effects of two nonlinear error functions 



Blocks 


A 


B 


C 


z> 


E 


A 


* 


® b—a-\-ct\2At 


<d>c—a+omAt 


©d— a+a3iA^ 


®e— a+anAf 


B 


® a-6+anA* 


* 


®C— b+ac22At 


® d— 6+a 4 2A^ 


@ e— 6+a3iAi 


C 


a— c-\-a2\At 


© b — C-\-ct2\At 


* 


® d— C+ai2A< 


® g — C4-a 42 A/ 


D 


a — d-\-a,\2At 
®ma—d-\-a\2At 


© b-d+auAt 


® C— d-\-ct\\At 


* 


® 6 — d+a22Ai 


E 


a—e-\-a\iAt 
©«a— e-\-ao 2 At 


® b— e+a^At 


@c— e+auAf 


® d— e-\-a2iAt 


* 



Table 12. Result of application of equation (1) to values in table 11, indicating equalization of error in column footings 



Blocks 


A 


B 


c 


D 


E 


A 


* 


6-a+(an-/c)A£ 


c— a+(a3i — fc)A/ 


d-a+ct 2l At 


e— a+anA^ 


B 


a — b-\-anAt 


* 


c-&+(an— Jfe)Al 


d-b+(a n -k)At 


g— 6+a 3 iA^ 


C 


a — c-\-anAt 


6— c+asiAJ 


* 


d-c+(a n -k)At 


e— c+(a.n — fc)Ai 


D 


a-d-\-(ctn-k)At 


6— d+aaAt 


C— d+ofnAf 


* 


e-d+(a 2 i-/c)A< 


E 


a—e-\-(ac2i — k)At 


6~e+(a3i-fc)A/ 


C— C+a4iAf 


d— e+anAt 


* 


2 


ia—b—c—d—e 


ib—a—c—d—e 


4c— a— 6— d— 6 


id—a—b—c—e 


4«— a— 6— c — d 




+( Xy a -i-2k J At 


■H S«w-2*JAI 


+ ( y^«nl-L>fc J At 


+(y^«m-2fc JA< 


+( y^, «»i-2* JAi 


2/5 


1/5 4a-b-c-d-e 


1/5 4b-a-c-d-e 


1/5 4c-a-6-d-« 


1/5 4d-a-6-c-c 


1/5 4e-a-6-c-d 




+(S «»i-2fc JAi 


+ (S""- 2t )"] 


+(y^ani-2fc JA/ 


K§ "-*)"] 


Ks-*)"] 



Table 13. Result of applying least squares type of solution to data in table 12 



Blocks 


A 


B 


C 


I) 


E 


A 


* 


kAt 
b—a — — 


kAt 
c-a- — 


d-a+— 


, kAt 
e-a+— 


B 


. , kAt 
a-b+ T 


* 


. kAt 
c-b-- 


a ; k At 
d-b-— 


i i k At 
e-b+— 


C 


. kAt 


6-c+— 


* 


kAt 
d-c-— 


kAt 
e-c-— 


D 


. kAt 
a-d- — 


b-d+— 


..kAt 

c-d+ T 


* 


e-d-- 


E 


kAt 
a-e-— 


kAt 
b-e-— 


, kAt 


. .kAt 
d~e+— 


* 


2 


ia—b-c—d—e 


Ab—a—c—d—e 


4c— a— b— d— e 


Ad—a—b—c—e 


ie—a—b—c—d 


2/5 


l/5(4a—b—c—d—e) 


l/5(ib-a-c-d-e) 


l/5(4c-a-b-d-e) 


ll5{4d-a-b-c-e) 


l/5(4e-a-b-c-d) 



is constant). This means that the residual distribu- 
tions obtained when the least squares method of 
computation is employed will provide a more easily 
understood indication of inhomogeneity in the data. 
The fact that the two error functions differ by an 
amount k can be more readily determined from the 
residual distribution obtained when the least squares 
method is employed than when the method of com- 

549993—60 3 



putation illustrated in table 5 is used. Thus the 
method of least squares was adopted for the com- 
putation of all test results. 

The above discussion assumed the absence of ran- 
dom errors and in that event indicated that if the 
method of least squares is employed when there 
are two error functions differing by an amount k 
present, residuals of + (kAt/2) and —(IcAt/2) will 
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Table 14. Residuals obtained by applying to the data in table 12 
the method of computation illustrated in table 5 



Blocks 


A 


B 


C 


D 


E 


A 


* 


(a n -k)At 


(a n -k)At 


az\At 


anAt 


B 


anAt 


* 


(an-k)At 


(an-k)At 


an At 


C 


«3lA£ 


<X2lAt 


* 


(a n -k)At 


(an — k)At 


D 


(ctn—k)At 


anAt 


an At 


* 


(a 2i —k)At 


E 


(an-k)At 


(ctn-k)At 


anAt 


a 2l At 


* 



Table 15. Residuals obtained by applying to the data in table 12 
a least squares method of solution 



Blocks 


A 


B 


C 


D 


E 


A 


* 


kAt 
2 


kAt 
2 


.kAt 
"*" 2 


kAt 
"*" 2 


B 


kAt 
~^~ 2 


* 


kAt 

2 


kAt 
2 


,kAt 
+ 2 


C 


. kAt 

+ 2 


kAt 
+ 2 


* 


kAt 
2 


fcA* 

2 


D 


kAt 
2 


, kAt 

"*" 2 


, kAt 

+ 2 


* 


fcA« 

2 


E 


kAt 
2 


kAt 

2 


, kAt 
+ 2 


kAt 

+ 2 


* 



be obtained. If random errors are present, the 
residuals will tend to distribute randomly about 
-\- (kAt/2) and — (kAt/2) providing a bimodal distri- 
bution. 

If such a bimodal residual distribution is broken 
down into two distributions, one obtained from first 
comparisons and the other from the second compari- 
sons in an intercomparison test, the medians of these 
two distributions will fall at + (kAt/2) and — (kAt/2) 
respectively. That such a separation between the 
medians of the residual distributions of the first and 
second comparisons evidences an inhomegeneity in 
the data brought about by an asymmetry in the 
actual handling of the blocks in each pair can be seen 
from the following example. Consider three blocks 
A, B, and Oof actual lengths, a, b, and c respectively. 
Let these blocks be compared according to the fol- 
lowing intercomparison schedule: 

1. B minus A. 

2. A minus B. 

3. A minus C. 

4. C minus A. 

5. C minus B. 

6. B minus C. 

Assume that there is some variation or asymmetry 
in the handling of the gage blocks which causes each 
pair to have its correct length difference in the first 
comparison of each pair, but to appear to have a 
length difference departing from this correct value 
by an amount aAt in the second comparison of each 
pair. Then the observed values obtained from the 
comparisons should be those shown in table 16, where 
the number of each comparison is also given by the 
circled figures on the chart. 



Table 16. Observed values which would be obtained in an 
intercomparison test affected by consistent asymmetrical 
handling of the gage blocks 



Blocks 


A 


B 


C 


A 
B 
C 


® a—b-\-aAt 
® a—c 


(Db-a 
© b-C+aAt 


® c—a-\-aAt 

®c-b 



Applying the first step in the least squares method 
of solution, that is dividing by two the alegebraic 
difference of comparisons symmetrical to the diag- 
onal, gives what might be called adjusted observed 
values for each comparison. Thus for comparison 1, 
an adjusted observed value would be obtained by 
subtracting the observed value for comparison 2 
(the comparison which is diagonally symmetrical to 
comparison 1) from the observed value for comparison 
1; e.g., (b — a) — (a—b-\-aAt) and then dividing this 
by two, 

(b— a) — (a— b + aAt)_2b— 2a— aAt 



This value for comparison 1 and the adjusted ob- 
served values for the other five comparisons are 
given in table 17 which also illustrates the next step 
in the calculations. The columns are summed as 
indicated and these summations are divided by the 
number of gage blocks to give column footings. 
Next, a calculated result for each comparison is 
computed by subtracting the column footings one 
from another. Thus, the calculated result for com- 
parison 1, the B minus A comparison, is obtained by 
subtracting the column footing of column A from 
that of column B; e.g., 

/2b—a—c\ /2a-b—c\ , 



Table 17. Adjusted observed values calculated from data in 
table 16 



Blocks 


A 


B 


C 


A 


* 


® 2b-2a-aAt 
2 


®2c-2a+aAt 
2 


B 


®2a-2b+aAt 
2 


* 


®2c-2b-aAt 
2 


C 


®2a-2c-aAt 
2 


®2/)-2c+aA£ 
2 


* 


S 


2a-b-c 


2b— a—c 


2c-a-b 


2/3 


2o-b—c 
3 


2b—a-c 
3 


2c-a—b 
3 



These calculated results are shown in table 18. The 
residuals are then obtained by subtracting the cal- 
culated result for any comparison (table 18) from 
the adjusted observed value for that comparison 
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Table 18. Calculated results obtained from data in table 17 



I Mocks 


A 


B 


C 


A 


* 


®b-a 


®c-a 


B 


®a-b 


* 


®c-b 


C 


®a—c 


®b-c 


* 



Table 19. Residuals obtained from data in tables 17 and 18 



Blocks 


A 


B 


C 


A 


* 


® aAt 
2 


® , cxM 


B 


® a\t 
+ 2 


* 


® aAt 
2 


C 


© a\t 
2 


® aAt 
+ 2 


* 



(table 17). Thus the residual for comparison 1 
would be given in this case by: 



( : 



2b-2a- 



-aAt\ /L s aAt 



The residuals for these comparisons are given in 
table 19 together with the number of the comparison. 
It should be noted from the comparison schedule 
that comparisons 1, 3, and 5 are first comparisons on 
each pair of blocks involved while comparisons 2, 4, 
and 6 are, in each case, second comparisons. From 
the residuals obtained, it can be seen that each first 
comparison gives a residual of — (aAt/2), while each 
second comparison gives a residual of -{-(aAt/2). 



i 



> 5 


r 1 


- 


O 

a: 

ho 







-aAt/2 o +az\t/2 

MAGNITUDE OF RESIDUALS , fi in. 

Figure 20. Frequency distribution of residuals which would 
be obtained in an inter comparison test if the co7nparisons of 
lengths are affected only by a consistent asymmetrical handling 
of the gage blocks. 



The residual distributions when plotted appear as 
in figure 20 where the total distribution is plotted at 
the bottom, the residuals from the first comparisons 
in the center distribution, and the residuals from the 
second comparisons in the distribution at the top of 
the figure. The split between the medians of the first 
and second comparison distributions which are indi- 
cated by the arrows is very apparent and is evidence 
of an asymmetry in the handling of the gage blocks. 
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